02.12.2021 17:25:00,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:00,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:00,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:00,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:00,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 386
02.12.2021 17:25:00,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:00,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:00,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239429ms delay out of 240000ms. Remaining 571ms. Executor queue at 0
02.12.2021 17:25:00,187 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239075ms for 240000ms of delay, sleeping for 935ms
02.12.2021 17:25:00,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:00,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 278
02.12.2021 17:25:00,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 516 ms and fetched 0 records
02.12.2021 17:25:00,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,234 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,234 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:00,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 28 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 29 iterations.
02.12.2021 17:25:00,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 29 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,294 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,295 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:00,297 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,297 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,298 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 77, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,298 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=928) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:00,298 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018341, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:00,298 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018351, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:00,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 4 ms and fetched 10 records
02.12.2021 17:25:00,301 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:00,301 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,301 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 29 iterations.
02.12.2021 17:25:00,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 283
02.12.2021 17:25:00,306 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,312 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119385ms for 120000ms of delay, sleeping for 625ms
02.12.2021 17:25:00,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:00,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 226
02.12.2021 17:25:00,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 183
02.12.2021 17:25:00,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:00,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 48
02.12.2021 17:25:00,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 125
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:00,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:00,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:00,592 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=641) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:00,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 273
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@692fcf25
02.12.2021 17:25:00,593 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:00,593 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,593 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 77, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,594 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=642) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 272
02.12.2021 17:25:00,593 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 185 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=641) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=185,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:00,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:00,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 209
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@19450714
02.12.2021 17:25:00,601 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 185 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:00,601 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:00,601 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:00,602 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 77, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:00,602 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=642) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:00,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 208
02.12.2021 17:25:00,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:00,678 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59800ms for 60000ms of delay, sleeping for 210ms
02.12.2021 17:25:00,693 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,701 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:00,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:00,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,748 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,748 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,749 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:00,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:00,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,810 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:00,816 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:00,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:00,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:00,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:00,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,866 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:00,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:00,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:00,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:00,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:00,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:00,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:00,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:00,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:00,889 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148928, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:00,889 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148938, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:00,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:00,890 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:00,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:00,890 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:00,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:00,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:00,890 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59986ms for 60000ms of delay, sleeping for 24ms
02.12.2021 17:25:00,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:00,915 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59753ms for 60000ms of delay, sleeping for 257ms
02.12.2021 17:25:00,939 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119962ms for 120000ms of delay, sleeping for 48ms
02.12.2021 17:25:00,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:00,964 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:00,964 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:00,964 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=847) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:00,988 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119133ms for 120000ms of delay, sleeping for 877ms
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,005 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,007 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,064 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=847): org.apache.kafka.common.requests.HeartbeatResponse@7c68ff27
02.12.2021 17:25:01,064 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:01,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239666ms for 240000ms of delay, sleeping for 344ms
02.12.2021 17:25:01,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:01,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59286ms for 60000ms of delay, sleeping for 724ms
02.12.2021 17:25:01,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:01,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,251 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,312 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,368 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:01,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:01,482 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239265ms for 240000ms of delay, sleeping for 745ms
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,552 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:01,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:01,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:01,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:01,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,751 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,751 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:01,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:01,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:01,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:01,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:01,838 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:01,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:01,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:01,852 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:01,868 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119286ms for 120000ms of delay, sleeping for 724ms
02.12.2021 17:25:01,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:01,872 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:01,872 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:01,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:01,927 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59958ms for 60000ms of delay, sleeping for 52ms
02.12.2021 17:25:01,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:01,995 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59486ms for 60000ms of delay, sleeping for 524ms
02.12.2021 17:25:02,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:02,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,036 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 457
02.12.2021 17:25:02,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:02,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 357
02.12.2021 17:25:02,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:02,245 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239425ms for 240000ms of delay, sleeping for 585ms
02.12.2021 17:25:02,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 257
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 249
02.12.2021 17:25:02,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,326 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,348 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,352 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 153
02.12.2021 17:25:02,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 149
02.12.2021 17:25:02,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 48
02.12.2021 17:25:02,459 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 46
02.12.2021 17:25:02,506 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,505 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:02,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:02,506 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=627) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:02,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:02,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 42
02.12.2021 17:25:02,506 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=627) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:02,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 249
02.12.2021 17:25:02,507 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=627): org.apache.kafka.common.requests.HeartbeatResponse@60fb9f1
02.12.2021 17:25:02,508 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 248
02.12.2021 17:25:02,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 248
02.12.2021 17:25:02,508 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=627): org.apache.kafka.common.requests.HeartbeatResponse@4ef2833a
02.12.2021 17:25:02,508 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:02,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:02,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 40
02.12.2021 17:25:02,521 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59524ms for 60000ms of delay, sleeping for 486ms
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,596 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119498ms for 120000ms of delay, sleeping for 512ms
02.12.2021 17:25:02,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 147
02.12.2021 17:25:02,649 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:02,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 45
02.12.2021 17:25:02,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:02,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:02,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,831 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239876ms for 240000ms of delay, sleeping for 134ms
02.12.2021 17:25:02,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:02,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,852 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:02,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:02,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:02,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:02,875 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:02,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:02,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:02,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:02,967 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239931ms for 240000ms of delay, sleeping for 79ms
02.12.2021 17:25:03,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:03,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,033 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148938, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:03,033 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148948, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:03,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:03,038 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:03,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 60 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 171119ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 171119ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:03,048 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967716, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:03,048 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967726, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:03,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:03,048 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:03,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,048 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:03,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 61 iterations.
02.12.2021 17:25:03,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239878ms for 240000ms of delay, sleeping for 132ms
02.12.2021 17:25:03,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:03,049 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59997ms for 60000ms of delay, sleeping for 13ms
02.12.2021 17:25:03,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,055 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,056 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:03,072 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59623ms for 60000ms of delay, sleeping for 387ms
02.12.2021 17:25:03,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118995ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:03,156 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:03,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239448ms for 240000ms of delay, sleeping for 562ms
02.12.2021 17:25:03,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,286 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,334 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,356 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:03,460 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59413ms for 60000ms of delay, sleeping for 597ms
02.12.2021 17:25:03,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,557 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:03,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:03,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:03,756 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239858ms for 240000ms of delay, sleeping for 152ms
02.12.2021 17:25:03,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:03,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,769 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:03,787 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,788 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,788 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,789 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,834 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:03,860 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:03,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:03,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:03,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:03,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:03,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:03,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:03,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:03,913 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239757ms for 240000ms of delay, sleeping for 253ms
02.12.2021 17:25:03,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:03,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:03,994 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:04,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:04,010 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=848) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:04,061 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59880ms for 60000ms of delay, sleeping for 130ms
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:04,120 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=632): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:04,123 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:04,123 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:04,123 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:04,123 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,123 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=633) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,118 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=632): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:04,114 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=848): org.apache.kafka.common.requests.HeartbeatResponse@4395c903
02.12.2021 17:25:04,126 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:04,126 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:04,130 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:04,131 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:04,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 166
02.12.2021 17:25:04,122 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119995ms delay out of 120000ms. Remaining 5ms. Executor queue at 0
02.12.2021 17:25:04,136 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119925ms for 120000ms of delay, sleeping for 85ms
02.12.2021 17:25:04,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:04,140 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=633) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,assignments=[]}
02.12.2021 17:25:04,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 220
02.12.2021 17:25:04,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,179 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239265ms for 240000ms of delay, sleeping for 745ms
02.12.2021 17:25:04,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:04,193 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=633): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,194 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=633): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,194 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:04,197 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,197 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,197 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,198 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,198 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,198 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from RUNNING to REBALANCING
02.12.2021 17:25:04,198 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 169
02.12.2021 17:25:04,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59206ms for 60000ms of delay, sleeping for 804ms
02.12.2021 17:25:04,195 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:04,216 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 55 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:04,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 29 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,224 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,216 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:04,225 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:04,225 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:04,225 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:04,226 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:04,225 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 32933ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:04,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:04,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 30 iterations.
02.12.2021 17:25:04,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 30 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:04,226 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 32935ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:04,226 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:04,247 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:04,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:04,248 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:04,248 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018351, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:04,259 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018361, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:04,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 12 ms and fetched 10 records
02.12.2021 17:25:04,272 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,273 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,279 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:04,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 30 iterations.
02.12.2021 17:25:04,289 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119992ms for 120000ms of delay, sleeping for 18ms
02.12.2021 17:25:04,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 64
02.12.2021 17:25:04,318 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118231ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,342 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 553 ms and fetched 0 records
02.12.2021 17:25:04,343 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:04,343 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,343 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,343 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,344 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:04,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:04,363 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:04,363 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from REBALANCING to RUNNING
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,364 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:04,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,380 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:04,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:04,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:04,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:04,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:04,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:04,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:04,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:04,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:04,840 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,842 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,843 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:04,865 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:04,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:04,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:04,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:04,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:04,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:04,884 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:04,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:04,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:04,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:04,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:04,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:04,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:04,930 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239028ms for 240000ms of delay, sleeping for 982ms
02.12.2021 17:25:04,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:04,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:04,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:05,021 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59177ms for 60000ms of delay, sleeping for 833ms
02.12.2021 17:25:05,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 435
02.12.2021 17:25:05,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:05,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,167 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:05,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 334
02.12.2021 17:25:05,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:05,252 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:05,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:05,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 224
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=642): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=642): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:05,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:05,291 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,291 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:05,292 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=643) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,292 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:05,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 51
02.12.2021 17:25:05,292 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=643) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:05,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:05,318 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119231ms delay out of 120000ms. Remaining 769ms. Executor queue at 0
02.12.2021 17:25:05,320 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119099ms for 120000ms of delay, sleeping for 911ms
02.12.2021 17:25:05,339 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=643): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,339 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,339 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=643): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,340 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:05,340 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:05,339 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:05,340 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:05,340 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 186 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:05,340 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,340 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,340 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:05,340 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,341 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,341 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,341 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:05,341 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 3
02.12.2021 17:25:05,340 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:05,341 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:05,341 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:05,342 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:05,342 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:05,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 45
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,344 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,344 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,345 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,347 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,365 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 134
02.12.2021 17:25:05,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 123
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:05,387 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:05,388 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:05,388 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:05,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:05,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 33
02.12.2021 17:25:05,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:05,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:05,505 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,505 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,505 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=628) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:05,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:05,506 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=628): org.apache.kafka.common.requests.HeartbeatResponse@1eb8addd
02.12.2021 17:25:05,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:05,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:05,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:05,507 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:05,507 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:05,507 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=628) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:05,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 275
02.12.2021 17:25:05,508 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=628): org.apache.kafka.common.requests.HeartbeatResponse@443f7deb
02.12.2021 17:25:05,508 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:05,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 274
02.12.2021 17:25:05,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 274
02.12.2021 17:25:05,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:05,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:05,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:05,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 174
02.12.2021 17:25:05,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:05,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:05,670 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:05,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:05,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:05,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:05,747 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:05,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:05,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:05,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,783 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:05,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,846 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,859 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58876ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:05,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:05,874 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,874 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:05,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:05,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:05,876 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:05,876 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:05,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:05,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:05,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:05,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:05,889 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:05,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:05,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:05,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:05,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:05,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:05,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:05,917 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239848ms for 240000ms of delay, sleeping for 162ms
02.12.2021 17:25:05,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:05,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:05,978 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:05,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:05,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:05,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:06,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:06,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,071 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,072 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:06,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 61 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,088 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 174160ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 174161ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:06,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:06,089 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1188): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:06,095 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=55, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:06,095 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:06,095 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:06,096 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:06,096 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967726, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:06,096 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1189) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,assignments=[]}
02.12.2021 17:25:06,098 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967736, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:06,102 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1189): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:06,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 13 ms and fetched 10 records
02.12.2021 17:25:06,118 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:06,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,118 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 62 iterations.
02.12.2021 17:25:06,144 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238983ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:06,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:06,160 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:06,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,185 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:06,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:06,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:06,198 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=55, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:06,244 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119308ms for 120000ms of delay, sleeping for 702ms
02.12.2021 17:25:06,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:06,267 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:06,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:06,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:06,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:06,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,350 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,377 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:06,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,391 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,392 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:06,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:06,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:06,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:06,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,573 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:06,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:06,592 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:06,651 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:06,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:06,679 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:06,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:06,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:06,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:06,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:06,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:06,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:06,795 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,859 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59876ms delay out of 60000ms. Remaining 124ms. Executor queue at 0
02.12.2021 17:25:06,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:06,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:06,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:06,861 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148948, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:06,861 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148958, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:06,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:06,862 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:06,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,862 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:06,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 18 iterations.
02.12.2021 17:25:06,863 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59841ms for 60000ms of delay, sleeping for 169ms
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,866 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 257
02.12.2021 17:25:06,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:06,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:06,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:06,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:06,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:06,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 251
02.12.2021 17:25:06,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:06,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:06,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:06,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:06,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:06,950 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119779ms for 120000ms of delay, sleeping for 231ms
02.12.2021 17:25:06,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:06,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 157
02.12.2021 17:25:06,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 151
02.12.2021 17:25:06,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:06,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:06,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,034 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59597ms for 60000ms of delay, sleeping for 413ms
02.12.2021 17:25:07,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,055 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,055 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:07,055 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=849) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:07,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 56
02.12.2021 17:25:07,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,073 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,073 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 51
02.12.2021 17:25:07,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:07,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:07,123 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,124 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:07,124 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=634) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:07,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 241
02.12.2021 17:25:07,125 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=634): org.apache.kafka.common.requests.HeartbeatResponse@2fc810b4
02.12.2021 17:25:07,125 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,125 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:07,126 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,126 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,126 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 28, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,127 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=635) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 239
02.12.2021 17:25:07,137 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:07,138 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:07,138 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=634) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:07,139 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 240
02.12.2021 17:25:07,140 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=634): org.apache.kafka.common.requests.HeartbeatResponse@15094b89
02.12.2021 17:25:07,140 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:07,140 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 55 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:07,140 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:07,140 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:07,140 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 28, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:07,140 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=635) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:07,141 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 238
02.12.2021 17:25:07,144 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239983ms delay out of 240000ms. Remaining 17ms. Executor queue at 0
02.12.2021 17:25:07,147 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239546ms for 240000ms of delay, sleeping for 464ms
02.12.2021 17:25:07,156 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=849): org.apache.kafka.common.requests.HeartbeatResponse@7cbf6751
02.12.2021 17:25:07,160 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:07,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119183ms for 120000ms of delay, sleeping for 827ms
02.12.2021 17:25:07,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:07,225 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,239 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:07,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:07,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:07,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,296 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,354 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,366 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,366 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,367 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,393 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:07,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,449 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59499ms for 60000ms of delay, sleeping for 511ms
02.12.2021 17:25:07,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:07,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:07,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:07,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,576 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:07,597 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:07,615 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239758ms for 240000ms of delay, sleeping for 252ms
02.12.2021 17:25:07,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:07,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,695 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:07,697 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:07,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:07,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:07,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:07,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,796 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,797 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:07,856 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,857 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 434
02.12.2021 17:25:07,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,867 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,867 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,868 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,868 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 236186ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:07,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:07,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:07,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,880 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:07,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,880 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:07,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:07,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:07,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:07,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:07,893 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:07,896 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:07,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:07,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:07,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:07,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:07,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:07,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:07,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 393
02.12.2021 17:25:07,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 323
02.12.2021 17:25:07,970 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59277ms for 60000ms of delay, sleeping for 733ms
02.12.2021 17:25:07,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:07,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:07,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:08,022 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119622ms for 120000ms of delay, sleeping for 388ms
02.12.2021 17:25:08,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 219
02.12.2021 17:25:08,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:08,086 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,086 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,087 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 418
02.12.2021 17:25:08,098 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:08,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:08,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 119
02.12.2021 17:25:08,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 318
02.12.2021 17:25:08,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:08,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:08,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 18
02.12.2021 17:25:08,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 218
02.12.2021 17:25:08,293 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,293 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:08,294 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=644) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:08,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 63
02.12.2021 17:25:08,294 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@7bb8d6ff
02.12.2021 17:25:08,294 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,294 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:08,294 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,295 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,295 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 78, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,295 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=645) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 62
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,305 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,305 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 202
02.12.2021 17:25:08,306 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,306 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,306 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=644) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:08,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:08,307 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@6bd8ce2c
02.12.2021 17:25:08,307 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:08,307 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 186 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:08,307 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:08,307 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:08,308 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 78, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:08,308 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=645) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:08,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,357 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,368 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 116
02.12.2021 17:25:08,394 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 101
02.12.2021 17:25:08,407 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:08,412 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119364ms for 120000ms of delay, sleeping for 646ms
02.12.2021 17:25:08,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:08,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 1
02.12.2021 17:25:08,507 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,507 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,507 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=629) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:08,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:08,507 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=629): org.apache.kafka.common.requests.HeartbeatResponse@19c107dd
02.12.2021 17:25:08,507 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:08,508 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:08,508 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=629) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:08,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:08,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:08,509 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=629): org.apache.kafka.common.requests.HeartbeatResponse@36f6555
02.12.2021 17:25:08,509 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:08,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:08,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:08,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,598 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:08,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:08,707 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59993ms for 60000ms of delay, sleeping for 17ms
02.12.2021 17:25:08,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:08,726 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58587ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,802 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:08,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:08,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,806 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,806 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:08,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,858 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,868 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 237186ms delay out of 240000ms. Remaining 2814ms. Executor queue at 0
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,869 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 237186ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:08,869 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:08,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:08,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:08,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:08,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:08,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:08,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:09,006 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 30 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 37768ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 31 iterations.
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 31 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 37768ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=928): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:09,059 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=186, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:09,060 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:09,060 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:09,060 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:09,060 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018361, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:09,060 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018371, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:09,060 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=929) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:09,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:09,061 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:09,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,061 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:09,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 31 iterations.
02.12.2021 17:25:09,061 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119942ms for 120000ms of delay, sleeping for 68ms
02.12.2021 17:25:09,098 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:09,119 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:09,120 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 55 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:09,120 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1190) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=55,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:09,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119802ms for 120000ms of delay, sleeping for 208ms
02.12.2021 17:25:09,161 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=929): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:09,170 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=186, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:09,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:09,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:09,220 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1190): org.apache.kafka.common.requests.HeartbeatResponse@34eb253
02.12.2021 17:25:09,222 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,306 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,307 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,360 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119204ms for 120000ms of delay, sleeping for 806ms
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,370 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,384 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,401 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,401 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:09,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:09,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:09,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:09,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:09,726 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59587ms delay out of 60000ms. Remaining 413ms. Executor queue at 1
02.12.2021 17:25:09,728 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58681ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:09,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:09,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,807 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,807 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,808 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,871 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,870 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 238187ms delay out of 240000ms. Remaining 1813ms. Executor queue at 2
02.12.2021 17:25:09,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:09,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:09,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:09,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:09,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:09,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238203ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:09,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:09,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:09,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:09,908 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:10,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:10,074 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:10,087 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:10,087 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=850) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:10,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:10,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,115 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,115 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,171 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119645ms for 120000ms of delay, sleeping for 365ms
02.12.2021 17:25:10,188 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=850): org.apache.kafka.common.requests.HeartbeatResponse@6bcd01ff
02.12.2021 17:25:10,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:10,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:10,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,308 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,362 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,386 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:10,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:10,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:10,549 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119466ms for 120000ms of delay, sleeping for 544ms
02.12.2021 17:25:10,618 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:10,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,625 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:10,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:10,728 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59681ms delay out of 60000ms. Remaining 319ms. Executor queue at 2
02.12.2021 17:25:10,729 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59906ms for 60000ms of delay, sleeping for 104ms
02.12.2021 17:25:10,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:10,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:10,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:10,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:10,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 18 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 33823ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:10,837 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Flushing record collector
02.12.2021 17:25:10,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Prepared RUNNING task for committing
02.12.2021 17:25:10,837 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-7=OffsetAndMetadata{offset=1148958, leaderEpoch=null, metadata='AQAAAX179eAn'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:10,838 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=851) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=7,committed_offset=1148958,committed_leader_epoch=-1,committed_metadata=AQAAAX179eAn}]}]}
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=851): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=7, errorCode=0)])])
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1148958 for partition redacted.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-7=1148957}
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:10,852 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Committed all active tasks [0_7] and standby tasks [] in 0ms
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:10,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:10,854 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148958, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:10,854 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148968, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:10,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:10,855 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:10,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,855 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:10,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:10,856 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59779ms for 60000ms of delay, sleeping for 231ms
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,862 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,887 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,888 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,888 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:10,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:10,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:10,892 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239204ms delay out of 240000ms. Remaining 796ms. Executor queue at 3
02.12.2021 17:25:10,894 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239203ms for 240000ms of delay, sleeping for 807ms
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:10,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:10,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:10,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:10,931 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:11,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:11,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:11,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119886ms for 120000ms of delay, sleeping for 124ms
02.12.2021 17:25:11,116 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59940ms for 60000ms of delay, sleeping for 70ms
02.12.2021 17:25:11,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 380
02.12.2021 17:25:11,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59123ms for 60000ms of delay, sleeping for 887ms
02.12.2021 17:25:11,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:11,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:11,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119799ms for 120000ms of delay, sleeping for 211ms
02.12.2021 17:25:11,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,318 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,318 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:11,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,363 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,389 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:11,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:11,449 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118360ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:11,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,506 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,507 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=630) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:11,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:11,507 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=630): org.apache.kafka.common.requests.HeartbeatResponse@5d9f2e61
02.12.2021 17:25:11,507 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 119
02.12.2021 17:25:11,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:11,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:11,508 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:11,509 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:11,509 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=630) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:11,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 310
02.12.2021 17:25:11,509 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=630): org.apache.kafka.common.requests.HeartbeatResponse@51fdab83
02.12.2021 17:25:11,509 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:11,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 310
02.12.2021 17:25:11,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 310
02.12.2021 17:25:11,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 18
02.12.2021 17:25:11,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 62 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 179777ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 179778ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:11,706 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:11,706 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:11,706 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 28, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1191) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:11,707 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967736, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:11,707 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967746, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:11,707 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 63 iterations.
02.12.2021 17:25:11,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 109
02.12.2021 17:25:11,715 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239542ms for 240000ms of delay, sleeping for 468ms
02.12.2021 17:25:11,727 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:11,727 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:11,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 8
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:11,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:11,864 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,873 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:11,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,902 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:11,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:11,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:11,905 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:11,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:11,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:11,907 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:11,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:11,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:12,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:12,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:12,087 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:12,087 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 186 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:12,087 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=930) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=186,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null}
02.12.2021 17:25:12,090 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59972ms for 60000ms of delay, sleeping for 38ms
02.12.2021 17:25:12,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,128 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,128 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,143 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59990ms for 60000ms of delay, sleeping for 20ms
02.12.2021 17:25:12,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59837ms for 60000ms of delay, sleeping for 173ms
02.12.2021 17:25:12,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239047ms for 240000ms of delay, sleeping for 963ms
02.12.2021 17:25:12,188 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=930): org.apache.kafka.common.requests.HeartbeatResponse@60b93c0a
02.12.2021 17:25:12,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:12,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:12,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:12,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:12,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,329 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,350 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59293ms for 60000ms of delay, sleeping for 717ms
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,380 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 514 ms and fetched 0 records
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,405 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,412 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:12,434 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:12,449 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119360ms delay out of 120000ms. Remaining 640ms. Executor queue at 0
02.12.2021 17:25:12,451 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119356ms for 120000ms of delay, sleeping for 654ms
02.12.2021 17:25:12,530 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:12,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,628 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:12,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:12,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:12,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:12,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,881 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,905 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:12,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:12,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:12,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:12,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:12,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:12,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:12,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:13,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:13,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 9 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:13,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58781ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:13,099 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:13,099 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:13,099 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=852) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 31 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 41815ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 32 iterations.
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 32 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 41815ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:13,106 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:13,107 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:13,107 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:13,107 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:13,107 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 78, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:13,107 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=931) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:13,107 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018371, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:13,107 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018381, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:13,107 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:13,108 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:13,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,108 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:13,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,108 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 32 iterations.
02.12.2021 17:25:13,108 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119983ms for 120000ms of delay, sleeping for 27ms
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119897ms for 120000ms of delay, sleeping for 113ms
02.12.2021 17:25:13,160 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239025ms for 240000ms of delay, sleeping for 985ms
02.12.2021 17:25:13,198 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=852): org.apache.kafka.common.requests.HeartbeatResponse@50e75a66
02.12.2021 17:25:13,200 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:13,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,251 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119983ms for 120000ms of delay, sleeping for 27ms
02.12.2021 17:25:13,280 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118461ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:13,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:13,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,382 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,406 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,408 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,408 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,422 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:13,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,638 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:13,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:13,739 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:13,836 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,837 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:13,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,884 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,885 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,909 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:13,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:13,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,909 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:13,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,911 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:13,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:13,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:13,924 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:13,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:13,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:13,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:13,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:13,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:13,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:13,954 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:13,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 381
02.12.2021 17:25:14,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:14,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 278
02.12.2021 17:25:14,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59781ms delay out of 60000ms. Remaining 219ms. Executor queue at 0
02.12.2021 17:25:14,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 1 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:14,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,079 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,080 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 1 fetched records at offset FetchPosition{offset=1148968, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:14,080 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148969, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry1-7 at position FetchPosition{offset=1148969, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}} to node kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Built incremental fetch (sessionId=1139041376, epoch=167) for node 2. Added (), altered (redacted.Cloud.Message.Callback.Retry1-7), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry1-7)
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry1-7), toForget=(), implied=()) to broker kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=853) and timeout 30000 to node 2: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1139041376,session_epoch=167,topics=[{topic=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition=7,current_leader_epoch=-1,fetch_offset=1148969,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 1 records
02.12.2021 17:25:14,080 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 1
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,080 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:14,081 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59302ms for 60000ms of delay, sleeping for 708ms
02.12.2021 17:25:14,103 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received FETCH response from node 2 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=853): org.apache.kafka.common.requests.FetchResponse@3d574ca8
02.12.2021 17:25:14,103 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Node 2 sent an incremental fetch response with throttleTimeMs = 0 for session 1139041376 with response=(redacted.Cloud.Message.Callback.Retry1-7)
02.12.2021 17:25:14,105 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Fetch READ_UNCOMMITTED at offset 1148969 for partition redacted.Cloud.Message.Callback.Retry1-7 returned fetch data (error=NONE, highWaterMark=1149104, lastStableOffset = 1149104, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=61545)
02.12.2021 17:25:14,146 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239965ms for 240000ms of delay, sleeping for 45ms
02.12.2021 17:25:14,140 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,149 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,149 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 357
02.12.2021 17:25:14,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=645): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:14,162 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:14,162 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,162 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:14,162 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=645): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:14,168 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:14,171 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:14,171 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:14,167 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,171 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=646) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,171 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 253
02.12.2021 17:25:14,173 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=646) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 207
02.12.2021 17:25:14,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 160
02.12.2021 17:25:14,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238971ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:14,249 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 257
02.12.2021 17:25:14,280 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119461ms delay out of 120000ms. Remaining 539ms. Executor queue at 1
02.12.2021 17:25:14,280 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119426ms for 120000ms of delay, sleeping for 584ms
02.12.2021 17:25:14,282 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:14,293 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=646): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,293 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=646): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,301 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,301 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:14,301 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,305 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:14,305 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,305 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:14,311 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,311 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 187 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:14,311 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,311 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,311 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:14,318 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,318 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,318 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:14,318 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,318 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,319 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 125
02.12.2021 17:25:14,318 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,319 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:14,319 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:14,339 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=635): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:14,341 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,341 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:14,340 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=635): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:14,341 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:14,341 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:14,341 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:14,341 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,341 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=636) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 68
02.12.2021 17:25:14,341 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:14,342 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=636) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:14,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 70
02.12.2021 17:25:14,349 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=636): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,383 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=636): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:14,384 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:14,384 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,384 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,384 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,384 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,384 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,384 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from RUNNING to REBALANCING
02.12.2021 17:25:14,384 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 26
02.12.2021 17:25:14,383 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 56 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:14,385 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:14,385 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:14,385 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:14,385 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:14,385 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:14,385 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:14,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 32
02.12.2021 17:25:14,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 518 ms and fetched 0 records
02.12.2021 17:25:14,403 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,403 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,403 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,404 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,411 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,411 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:14,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,418 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,418 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,418 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 7
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:14,426 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:14,427 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:14,427 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:14,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 56
02.12.2021 17:25:14,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,506 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,506 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=631) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:14,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 143
02.12.2021 17:25:14,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:14,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:14,510 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=631) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:14,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 330
02.12.2021 17:25:14,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=631): org.apache.kafka.common.requests.HeartbeatResponse@72e8dbb
02.12.2021 17:25:14,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:14,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 135
02.12.2021 17:25:14,516 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=631): org.apache.kafka.common.requests.HeartbeatResponse@2a46507c
02.12.2021 17:25:14,517 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:14,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 323
02.12.2021 17:25:14,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:14,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 321
02.12.2021 17:25:14,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:14,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:14,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 35
02.12.2021 17:25:14,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:14,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 221
02.12.2021 17:25:14,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,705 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:14,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:14,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:14,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:14,750 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:14,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 1 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:14,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:14,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:14,790 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Preparing to read 61545 bytes of data for partition redacted.Cloud.Message.Callback.Retry1-7 with offset FetchPosition{offset=1148969, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}}
02.12.2021 17:25:14,790 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry1-7 to 1149104
02.12.2021 17:25:14,790 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry1-7 to 0
02.12.2021 17:25:14,790 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry1-7 to 1149104
02.12.2021 17:25:14,791 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148969, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:14,791 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148979, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:14,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:14,791 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:14,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,791 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:14,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:14,792 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59939ms for 60000ms of delay, sleeping for 71ms
02.12.2021 17:25:14,806 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:14,812 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:14,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:14,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:14,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:14,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,843 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,849 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:14,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:14,866 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58783ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:14,867 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119897ms for 120000ms of delay, sleeping for 113ms
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,906 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,906 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:14,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:14,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:14,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:14,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:14,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:14,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:14,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:14,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:14,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119829ms for 120000ms of delay, sleeping for 181ms
02.12.2021 17:25:15,007 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:15,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:15,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:15,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:15,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:15,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:15,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:15,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:15,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:15,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,171 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119261ms for 120000ms of delay, sleeping for 749ms
02.12.2021 17:25:15,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:15,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239973ms delay out of 240000ms. Remaining 27ms. Executor queue at 0
02.12.2021 17:25:15,210 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239338ms for 240000ms of delay, sleeping for 672ms
02.12.2021 17:25:15,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:15,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:15,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:15,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:15,308 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:15,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:15,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:15,352 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,407 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,407 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,419 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:15,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:15,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:15,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:15,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:15,608 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:15,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:15,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:15,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:15,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:15,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:15,734 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:15,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:15,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:15,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:15,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 90
02.12.2021 17:25:15,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,854 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:15,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:15,866 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59783ms delay out of 60000ms. Remaining 217ms. Executor queue at 0
02.12.2021 17:25:15,867 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59973ms for 60000ms of delay, sleeping for 37ms
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 63 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 183967ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 183967ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:15,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:15,897 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1191): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:15,897 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=56, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:15,898 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:15,898 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:15,898 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:15,900 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967746, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:15,900 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967756, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:15,900 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1192) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,assignments=[]}
02.12.2021 17:25:15,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:15,903 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 64 iterations.
02.12.2021 17:25:15,905 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239659ms for 240000ms of delay, sleeping for 351ms
02.12.2021 17:25:15,909 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:15,909 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,913 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,913 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59728ms for 60000ms of delay, sleeping for 282ms
02.12.2021 17:25:15,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,916 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:15,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:15,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:15,930 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119785ms for 120000ms of delay, sleeping for 225ms
02.12.2021 17:25:15,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:15,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:15,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:15,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:15,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:16,002 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1192): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:16,003 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=56, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:16,016 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:16,060 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:16,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:16,110 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:16,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:16,113 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=854) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:16,116 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:16,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:16,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 284
02.12.2021 17:25:16,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 32 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,160 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 44871ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:16,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:16,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 33 iterations.
02.12.2021 17:25:16,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30258ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 33 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 44884ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=931): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=187, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:16,175 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:16,176 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=932) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:16,176 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018381, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:16,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,183 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018391, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:16,184 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=932): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:16,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 16 ms and fetched 10 records
02.12.2021 17:25:16,191 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:16,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,191 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:16,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 33 iterations.
02.12.2021 17:25:16,199 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119324ms for 120000ms of delay, sleeping for 686ms
02.12.2021 17:25:16,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57940ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:16,213 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=854): org.apache.kafka.common.requests.HeartbeatResponse@3ad531bc
02.12.2021 17:25:16,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:16,216 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:16,228 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:16,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:16,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239094ms for 240000ms of delay, sleeping for 916ms
02.12.2021 17:25:16,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 179
02.12.2021 17:25:16,270 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:16,276 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=187, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:16,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:16,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:16,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:16,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 75
02.12.2021 17:25:16,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30285ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:16,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,394 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,417 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:16,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:16,494 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:16,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:16,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:16,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:16,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:16,595 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:16,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:16,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:16,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:16,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,684 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:16,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:16,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:16,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:16,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:16,785 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:16,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:16,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:16,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:16,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:16,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119970ms for 120000ms of delay, sleeping for 40ms
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 253
02.12.2021 17:25:16,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:16,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:16,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 419
02.12.2021 17:25:16,932 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119398ms for 120000ms of delay, sleeping for 612ms
02.12.2021 17:25:16,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 408
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:16,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:16,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:16,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 225
02.12.2021 17:25:16,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:16,985 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:17,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 152
02.12.2021 17:25:17,022 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 319
02.12.2021 17:25:17,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 307
02.12.2021 17:25:17,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 125
02.12.2021 17:25:17,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:17,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:17,120 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 51
02.12.2021 17:25:17,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 218
02.12.2021 17:25:17,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 207
02.12.2021 17:25:17,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 25
02.12.2021 17:25:17,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:17,162 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,162 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,163 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=647) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:17,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 274
02.12.2021 17:25:17,163 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=647): org.apache.kafka.common.requests.HeartbeatResponse@224a375
02.12.2021 17:25:17,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,163 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:17,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,164 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,164 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 79, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,164 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=648) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 273
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:17,171 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,171 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,172 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=647) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:17,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 247
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=647): org.apache.kafka.common.requests.HeartbeatResponse@3ada0b26
02.12.2021 17:25:17,173 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 187 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:17,173 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 79, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:17,173 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=648) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 245
02.12.2021 17:25:17,175 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239031ms for 240000ms of delay, sleeping for 979ms
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 319
02.12.2021 17:25:17,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58940ms delay out of 60000ms. Remaining 1060ms. Executor queue at 0
02.12.2021 17:25:17,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58304ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:17,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 114
02.12.2021 17:25:17,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 106
02.12.2021 17:25:17,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:17,263 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,272 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:17,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 218
02.12.2021 17:25:17,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 14
02.12.2021 17:25:17,335 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 6
02.12.2021 17:25:17,341 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,342 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,342 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,342 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=637) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:17,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:17,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:17,342 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@6ce2213e
02.12.2021 17:25:17,343 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,343 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:17,343 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,343 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,343 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,344 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=638) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:17,342 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,344 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,345 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=637) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@5992b5b7
02.12.2021 17:25:17,346 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 56 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:17,346 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:17,346 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=638) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:17,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 76
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:17,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 118
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,420 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,434 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,437 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,442 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,446 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:17,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 48
02.12.2021 17:25:17,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 17
02.12.2021 17:25:17,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,506 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,506 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,507 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=632) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:17,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:17,509 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=632): org.apache.kafka.common.requests.HeartbeatResponse@5ca30ec6
02.12.2021 17:25:17,509 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:17,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 178
02.12.2021 17:25:17,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:17,511 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:17,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=632) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:17,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 351
02.12.2021 17:25:17,512 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=632): org.apache.kafka.common.requests.HeartbeatResponse@15a9a0fa
02.12.2021 17:25:17,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:17,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 350
02.12.2021 17:25:17,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 350
02.12.2021 17:25:17,547 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119650ms for 120000ms of delay, sleeping for 360ms
02.12.2021 17:25:17,610 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:17,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 250
02.12.2021 17:25:17,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 149
02.12.2021 17:25:17,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:17,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 49
02.12.2021 17:25:17,863 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,877 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:17,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:17,920 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119982ms for 120000ms of delay, sleeping for 28ms
02.12.2021 17:25:17,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,924 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:17,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:17,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:17,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:17,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:17,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:17,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:17,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:17,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:17,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:17,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:17,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:17,955 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119803ms for 120000ms of delay, sleeping for 207ms
02.12.2021 17:25:17,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:17,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:18,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:18,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:18,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239262ms for 240000ms of delay, sleeping for 748ms
02.12.2021 17:25:18,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118148ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:18,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:18,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,191 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,191 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59304ms delay out of 60000ms. Remaining 696ms. Executor queue at 1
02.12.2021 17:25:18,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58411ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:18,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:18,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,429 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,429 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,430 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,447 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:18,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:18,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:18,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:18,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,695 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,788 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:18,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,882 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:18,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:18,914 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 56 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:18,915 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1193) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=56,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:18,914 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239745ms for 240000ms of delay, sleeping for 265ms
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:18,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:18,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30268ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:18,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:18,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30254ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:18,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:18,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:18,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:18,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:18,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:18,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:18,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,015 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1193): org.apache.kafka.common.requests.HeartbeatResponse@10aa93bb
02.12.2021 17:25:19,015 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:19,084 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:19,103 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:19,131 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:19,131 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:19,131 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=855) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:19,168 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119148ms delay out of 120000ms. Remaining 852ms. Executor queue at 0
02.12.2021 17:25:19,176 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119122ms for 120000ms of delay, sleeping for 888ms
02.12.2021 17:25:19,184 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:19,184 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239072ms for 240000ms of delay, sleeping for 938ms
02.12.2021 17:25:19,184 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 187 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:19,184 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:19,194 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=933) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=187,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null}
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,201 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,201 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59411ms delay out of 60000ms. Remaining 589ms. Executor queue at 1
02.12.2021 17:25:19,209 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58450ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=855): org.apache.kafka.common.requests.HeartbeatResponse@39141de0
02.12.2021 17:25:19,232 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:19,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:19,296 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=933): org.apache.kafka.common.requests.HeartbeatResponse@7f4e5e5a
02.12.2021 17:25:19,296 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:19,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,382 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,402 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30769ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30755ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:19,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:19,588 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:19,602 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:19,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:19,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:19,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,707 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,708 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,708 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:19,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:19,883 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,890 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,890 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:19,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:19,932 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,937 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,937 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31272ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31259ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:19,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:19,948 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:19,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:19,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:19,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:20,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:20,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118974ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:20,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:20,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:20,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 64 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 188215ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 188215ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,143 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:20,144 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:20,144 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:20,144 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:20,144 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 29, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:20,153 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1194) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:20,154 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967756, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:20,154 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967766, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:20,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 10 ms and fetched 10 records
02.12.2021 17:25:20,168 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:20,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:20,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,168 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 65 iterations.
02.12.2021 17:25:20,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:20,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 289
02.12.2021 17:25:20,216 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59457ms delay out of 60000ms. Remaining 543ms. Executor queue at 0
02.12.2021 17:25:20,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:20,226 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58993ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:20,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239994ms for 240000ms of delay, sleeping for 16ms
02.12.2021 17:25:20,265 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239309ms for 240000ms of delay, sleeping for 701ms
02.12.2021 17:25:20,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:20,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,391 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,391 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 120
02.12.2021 17:25:20,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:20,438 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,439 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31773ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,444 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31761ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,449 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 20
02.12.2021 17:25:20,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,507 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,507 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,507 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=633) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:20,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 210
02.12.2021 17:25:20,508 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=633): org.apache.kafka.common.requests.HeartbeatResponse@4d4d0560
02.12.2021 17:25:20,508 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:20,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 208
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:20,512 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:20,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:20,513 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=633) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:20,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 379
02.12.2021 17:25:20,513 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=633): org.apache.kafka.common.requests.HeartbeatResponse@6d942ad7
02.12.2021 17:25:20,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:20,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 378
02.12.2021 17:25:20,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 378
02.12.2021 17:25:20,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:20,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 277
02.12.2021 17:25:20,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,718 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 173
02.12.2021 17:25:20,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:20,821 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:20,891 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,892 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,893 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:20,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:20,939 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:20,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,940 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32275ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32262ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:20,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:20,951 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:20,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:20,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:20,974 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239375ms for 240000ms of delay, sleeping for 635ms
02.12.2021 17:25:20,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:21,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:21,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119974ms delay out of 120000ms. Remaining 26ms. Executor queue at 0
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 33 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 49775ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 34 iterations.
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 34 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 49775ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:21,066 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:21,066 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:21,066 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:21,067 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 79, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:21,067 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=934) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:21,067 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018391, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:21,067 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018401, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:21,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:21,068 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:21,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:21,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 34 iterations.
02.12.2021 17:25:21,068 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119098ms for 120000ms of delay, sleeping for 912ms
02.12.2021 17:25:21,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:21,104 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:21,122 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:21,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:21,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:21,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:21,236 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:21,237 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148979, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:21,237 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148989, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:21,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:21,237 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:21,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,237 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:21,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:21,237 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59415ms for 60000ms of delay, sleeping for 595ms
02.12.2021 17:25:21,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:21,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,392 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,393 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,442 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32776ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,448 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,448 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32762ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,493 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:21,617 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239433ms for 240000ms of delay, sleeping for 577ms
02.12.2021 17:25:21,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:21,694 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,797 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:21,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:21,834 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59998ms for 60000ms of delay, sleeping for 12ms
02.12.2021 17:25:21,848 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59880ms for 60000ms of delay, sleeping for 130ms
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:21,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:21,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33263ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:21,952 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:21,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:21,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:21,964 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:21,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:21,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:21,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:21,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:21,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33293ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:21,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:21,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:21,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:21,982 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119796ms for 120000ms of delay, sleeping for 214ms
02.12.2021 17:25:21,987 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59253ms for 60000ms of delay, sleeping for 757ms
02.12.2021 17:25:21,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,032 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:22,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:22,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:22,141 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:22,141 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:22,142 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=856) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:22,187 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=638): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:22,187 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=638): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:22,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:22,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,187 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:22,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,188 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=639) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 277
02.12.2021 17:25:22,187 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:22,193 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:22,193 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,194 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=639) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:22,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 258
02.12.2021 17:25:22,200 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239018ms for 240000ms of delay, sleeping for 992ms
02.12.2021 17:25:22,211 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119146ms for 120000ms of delay, sleeping for 864ms
02.12.2021 17:25:22,242 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=856): org.apache.kafka.common.requests.HeartbeatResponse@53ca54ce
02.12.2021 17:25:22,242 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:22,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,244 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,244 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:22,321 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=639): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,321 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=639): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,325 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,325 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:22,324 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,326 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:22,326 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:22,326 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,326 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,326 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,327 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,327 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,327 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,327 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 128
02.12.2021 17:25:22,326 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 57 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:22,327 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:22,330 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,330 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,335 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:22,336 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,336 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:22,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 140
02.12.2021 17:25:22,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 387
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,396 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 25
02.12.2021 17:25:22,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 25
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,445 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,453 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,453 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,454 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,454 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,454 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 33767ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:22,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:22,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,465 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,465 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,465 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,465 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,466 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,466 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 33795ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:22,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:22,557 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:22,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:22,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:22,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:22,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:22,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:22,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:22,680 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=648): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:22,680 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:22,680 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,680 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:22,680 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,681 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=649) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 264
02.12.2021 17:25:22,680 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=648): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:22,683 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:22,683 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=649) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:22,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 273
02.12.2021 17:25:22,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:22,717 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=649): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,718 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=649): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,718 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,718 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:22,718 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:22,719 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,719 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,729 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,729 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,730 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,730 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:22,730 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 227
02.12.2021 17:25:22,718 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:22,733 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:22,735 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 188 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:22,735 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:22,735 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:22,735 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:22,736 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:22,736 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:22,736 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:22,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 239
02.12.2021 17:25:22,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:22,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,752 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,753 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,754 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59915ms for 60000ms of delay, sleeping for 95ms
02.12.2021 17:25:22,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:22,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:22,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:22,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 115
02.12.2021 17:25:22,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 120
02.12.2021 17:25:22,851 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59813ms for 60000ms of delay, sleeping for 197ms
02.12.2021 17:25:22,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:22,859 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:22,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:22,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,898 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:22,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 15
02.12.2021 17:25:22,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 19
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,946 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,946 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,946 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:22,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:22,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:22,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:22,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:22,962 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,962 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:22,962 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:22,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:22,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:22,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:22,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:23,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:23,054 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59916ms for 60000ms of delay, sleeping for 94ms
02.12.2021 17:25:23,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:23,077 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119979ms for 120000ms of delay, sleeping for 31ms
02.12.2021 17:25:23,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,109 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119975ms for 120000ms of delay, sleeping for 35ms
02.12.2021 17:25:23,145 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119026ms for 120000ms of delay, sleeping for 984ms
02.12.2021 17:25:23,147 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59898ms for 60000ms of delay, sleeping for 112ms
02.12.2021 17:25:23,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:23,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 85
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 65 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 191266ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 191266ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:23,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1194): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=57, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:23,195 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:23,195 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967766, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:23,195 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967776, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:23,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1195) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,assignments=[]}
02.12.2021 17:25:23,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:23,196 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1195): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:23,197 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=57, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:23,198 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:23,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,198 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,199 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 66 iterations.
02.12.2021 17:25:23,200 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:23,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239224ms for 240000ms of delay, sleeping for 786ms
02.12.2021 17:25:23,248 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 253
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:23,262 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148989, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:23,262 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1148999, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:23,262 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:23,263 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:23,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,263 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:23,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,263 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 14 iterations.
02.12.2021 17:25:23,263 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59409ms for 60000ms of delay, sleeping for 601ms
02.12.2021 17:25:23,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:23,301 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:23,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,355 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 152
02.12.2021 17:25:23,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:23,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:23,369 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,446 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,447 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,455 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 52
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,501 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 11
02.12.2021 17:25:23,507 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,508 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,510 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,510 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,510 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=634) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:23,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 244
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=634): org.apache.kafka.common.requests.HeartbeatResponse@6985d68e
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:23,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:23,515 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=634) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:23,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:23,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=634): org.apache.kafka.common.requests.HeartbeatResponse@51893555
02.12.2021 17:25:23,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 239
02.12.2021 17:25:23,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 239
02.12.2021 17:25:23,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:23,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:23,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 385
02.12.2021 17:25:23,547 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:23,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:23,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:23,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 139
02.12.2021 17:25:23,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:23,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:23,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:23,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:23,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:23,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 37
02.12.2021 17:25:23,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:23,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:23,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:23,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:23,850 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:23,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:23,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:23,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:23,867 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59811ms for 60000ms of delay, sleeping for 199ms
02.12.2021 17:25:23,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:23,900 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,902 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,902 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:23,950 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:23,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:23,954 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:23,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,964 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:23,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,965 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,966 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:23,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:23,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:23,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:23,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:23,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:23,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:23,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:23,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:23,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:23,996 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239836ms for 240000ms of delay, sleeping for 174ms
02.12.2021 17:25:24,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:24,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:24,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 398
02.12.2021 17:25:24,074 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59269ms for 60000ms of delay, sleeping for 741ms
02.12.2021 17:25:24,075 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,109 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:24,149 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119230ms for 120000ms of delay, sleeping for 780ms
02.12.2021 17:25:24,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:24,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:24,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:24,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 292
02.12.2021 17:25:24,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 287
02.12.2021 17:25:24,209 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:24,222 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239039ms for 240000ms of delay, sleeping for 971ms
02.12.2021 17:25:24,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:24,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,274 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:24,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 182
02.12.2021 17:25:24,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 174
02.12.2021 17:25:24,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:24,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 85
02.12.2021 17:25:24,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:24,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 80
02.12.2021 17:25:24,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 70
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,410 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,459 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,465 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,466 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,466 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,472 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:24,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:24,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:24,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:24,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:24,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:24,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:24,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:24,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:24,675 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:24,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:24,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:24,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:24,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,776 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:24,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:24,817 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59986ms for 60000ms of delay, sleeping for 24ms
02.12.2021 17:25:24,847 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59653ms for 60000ms of delay, sleeping for 357ms
02.12.2021 17:25:24,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:24,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:24,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:24,877 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:24,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,915 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,919 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,919 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,920 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:24,931 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119998ms for 120000ms of delay, sleeping for 12ms
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 34 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 53653ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 35 iterations.
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 35 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 53653ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:24,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:24,945 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=934): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:24,945 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=188, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:24,945 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:24,945 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:24,945 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:24,946 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018401, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:24,947 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018411, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:24,947 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=935) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:24,947 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:24,947 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=935): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:24,947 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=188, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:24,948 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:24,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:24,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 35 iterations.
02.12.2021 17:25:24,948 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119978ms for 120000ms of delay, sleeping for 32ms
02.12.2021 17:25:24,962 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,963 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:24,967 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:24,967 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 226
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,973 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:24,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:24,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:24,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:24,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:24,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:24,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:24,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:24,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:24,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 211
02.12.2021 17:25:24,977 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:24,983 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119466ms for 120000ms of delay, sleeping for 544ms
02.12.2021 17:25:25,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:25,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 126
02.12.2021 17:25:25,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:25,077 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 110
02.12.2021 17:25:25,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:25,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,152 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,152 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:25,152 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=857) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:25,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:25,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 25
02.12.2021 17:25:25,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:25,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 9
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,189 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=640) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:25,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 286
02.12.2021 17:25:25,191 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@86372e1
02.12.2021 17:25:25,191 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,191 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:25,191 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,191 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,191 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=641) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,191 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 285
02.12.2021 17:25:25,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:25,194 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,195 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,195 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=640) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:25,195 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239279ms for 240000ms of delay, sleeping for 731ms
02.12.2021 17:25:25,195 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 273
02.12.2021 17:25:25,196 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@6babecbb
02.12.2021 17:25:25,196 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,196 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 57 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:25,196 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:25,196 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:25,196 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:25,196 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=641) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 271
02.12.2021 17:25:25,206 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59160ms for 60000ms of delay, sleeping for 850ms
02.12.2021 17:25:25,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:25,255 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=857): org.apache.kafka.common.requests.HeartbeatResponse@54ff6013
02.12.2021 17:25:25,256 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:25,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:25,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,277 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,290 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,295 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:25,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:25,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:25,376 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:25,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:25,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,464 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 216
02.12.2021 17:25:25,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,468 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,474 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 209
02.12.2021 17:25:25,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:25,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,528 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119384ms for 120000ms of delay, sleeping for 626ms
02.12.2021 17:25:25,564 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 116
02.12.2021 17:25:25,574 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 109
02.12.2021 17:25:25,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:25,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 15
02.12.2021 17:25:25,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 7
02.12.2021 17:25:25,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:25,680 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,681 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,681 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=650) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:25,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 283
02.12.2021 17:25:25,682 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@3de1255e
02.12.2021 17:25:25,682 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,682 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:25,682 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,682 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 80, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,683 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=651) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 281
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,684 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:25,685 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,685 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=650) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:25,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 289
02.12.2021 17:25:25,686 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@6efd4c72
02.12.2021 17:25:25,686 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:25,686 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 188 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:25,686 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:25,686 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 80, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:25,687 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=651) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:25,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 287
02.12.2021 17:25:25,722 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,781 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,786 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:25,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:25,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:25,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239011ms for 240000ms of delay, sleeping for 999ms
02.12.2021 17:25:25,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:25,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:25,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,987 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,971 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:25,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:25,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:25,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:25,991 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:25,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:25,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:25,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:26,059 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59647ms for 60000ms of delay, sleeping for 363ms
02.12.2021 17:25:26,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:26,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:26,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118897ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:26,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:26,203 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,205 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 57 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:26,205 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1196) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=57,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:26,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 188
02.12.2021 17:25:26,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 227
02.12.2021 17:25:26,305 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1196): org.apache.kafka.common.requests.HeartbeatResponse@23c023c6
02.12.2021 17:25:26,306 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:26,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 78
02.12.2021 17:25:26,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:26,424 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59372ms for 60000ms of delay, sleeping for 638ms
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:26,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,472 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,472 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:26,494 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,495 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:26,511 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=635) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:26,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 272
02.12.2021 17:25:26,511 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=635): org.apache.kafka.common.requests.HeartbeatResponse@1a35dd50
02.12.2021 17:25:26,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 272
02.12.2021 17:25:26,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:26,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:26,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:26,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=635) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:26,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 411
02.12.2021 17:25:26,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=635): org.apache.kafka.common.requests.HeartbeatResponse@49545aa8
02.12.2021 17:25:26,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:26,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 410
02.12.2021 17:25:26,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 410
02.12.2021 17:25:26,612 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:26,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 309
02.12.2021 17:25:26,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:26,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 207
02.12.2021 17:25:26,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,794 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,794 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 106
02.12.2021 17:25:26,895 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:26,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 5
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 66 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 195001ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 195001ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:26,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:26,929 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:26,929 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:26,930 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:26,930 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 30, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:26,931 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1197) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:26,931 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967776, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:26,932 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967786, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:26,934 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:26,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,935 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:26,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 67 iterations.
02.12.2021 17:25:26,935 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239853ms for 240000ms of delay, sleeping for 157ms
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:26,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:26,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:26,997 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:26,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,007 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:27,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,064 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59124ms for 60000ms of delay, sleeping for 886ms
02.12.2021 17:25:27,096 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239207ms for 240000ms of delay, sleeping for 803ms
02.12.2021 17:25:27,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:27,162 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119897ms delay out of 120000ms. Remaining 103ms. Executor queue at 0
02.12.2021 17:25:27,169 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119798ms for 120000ms of delay, sleeping for 212ms
02.12.2021 17:25:27,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:27,233 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:27,297 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,298 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,298 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,337 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:27,384 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119391ms for 120000ms of delay, sleeping for 619ms
02.12.2021 17:25:27,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,426 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,427 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,476 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:27,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:27,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:27,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:27,730 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:27,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:27,798 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,799 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,799 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:27,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:27,906 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239700ms for 240000ms of delay, sleeping for 310ms
02.12.2021 17:25:27,928 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:27,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 14 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:27,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:27,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:27,955 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:27,956 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 188 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:27,956 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=936) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=188,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null}
02.12.2021 17:25:27,955 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1148999, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:27,956 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149009, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:27,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:27,957 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:27,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,957 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:27,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 15 iterations.
02.12.2021 17:25:27,960 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59135ms for 60000ms of delay, sleeping for 875ms
02.12.2021 17:25:27,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:27,980 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,982 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:27,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:27,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:27,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:27,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:27,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30151ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:27,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,998 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:28,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30203ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,004 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:27,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,012 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119614ms for 120000ms of delay, sleeping for 396ms
02.12.2021 17:25:28,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:28,056 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=936): org.apache.kafka.common.requests.HeartbeatResponse@34187d59
02.12.2021 17:25:28,058 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:28,102 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:28,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:28,161 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:28,163 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:28,163 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=858) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:28,203 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:28,243 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239973ms for 240000ms of delay, sleeping for 37ms
02.12.2021 17:25:28,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:28,264 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=858): org.apache.kafka.common.requests.HeartbeatResponse@47b4e3e1
02.12.2021 17:25:28,264 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:28,293 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239147ms for 240000ms of delay, sleeping for 863ms
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,304 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,304 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 75
02.12.2021 17:25:28,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,411 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119978ms for 120000ms of delay, sleeping for 32ms
02.12.2021 17:25:28,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,432 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,445 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119162ms for 120000ms of delay, sleeping for 848ms
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,485 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30652ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,500 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:28,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,505 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30705ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:28,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:28,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:28,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:28,706 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:28,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,805 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:28,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:28,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:28,836 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59171ms for 60000ms of delay, sleeping for 839ms
02.12.2021 17:25:28,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:28,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:28,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:28,989 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:28,990 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:28,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:28,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:28,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:28,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:28,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:28,990 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:29,002 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,002 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31155ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,003 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31206ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,007 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,008 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,111 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:29,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:29,174 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239246ms for 240000ms of delay, sleeping for 764ms
02.12.2021 17:25:29,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:29,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 184
02.12.2021 17:25:29,295 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119601ms for 120000ms of delay, sleeping for 409ms
02.12.2021 17:25:29,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:29,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:29,411 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 100
02.12.2021 17:25:29,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,435 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 79
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,491 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Committing all active tasks [] and standby tasks [] since 31656ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Committing all active tasks [] and standby tasks [] since 31708ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,509 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:29,511 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,512 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=636) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:29,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:29,512 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=636): org.apache.kafka.common.requests.HeartbeatResponse@5e2435ee
02.12.2021 17:25:29,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:29,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:29,515 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:29,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:29,515 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=636) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:29,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 421
02.12.2021 17:25:29,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=636): org.apache.kafka.common.requests.HeartbeatResponse@11a29d08
02.12.2021 17:25:29,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:29,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 420
02.12.2021 17:25:29,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 420
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:29,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 320
02.12.2021 17:25:29,678 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59974ms for 60000ms of delay, sleeping for 36ms
02.12.2021 17:25:29,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 35 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 58414ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 36 iterations.
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 36 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 58415ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:29,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:29,707 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:29,708 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:29,708 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:29,708 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:29,708 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 80, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:29,709 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=937) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:29,709 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018411, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:29,709 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018421, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:29,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=651): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:29,710 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 36 iterations.
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:29,710 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=651): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:29,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,711 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:29,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:29,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:29,711 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:29,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,711 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=652) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,711 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:29,712 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=652) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:29,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 292
02.12.2021 17:25:29,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:29,711 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119802ms for 120000ms of delay, sleeping for 208ms
02.12.2021 17:25:29,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:29,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 219
02.12.2021 17:25:29,716 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58494ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:29,764 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:29,771 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=652): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,771 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,770 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=652): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,772 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:29,771 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:29,773 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:29,772 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:29,773 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,783 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,783 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,783 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,783 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,783 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:29,783 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 233
02.12.2021 17:25:29,775 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 189 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:29,788 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:29,793 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:29,795 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:29,796 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:29,798 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:29,798 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:29,799 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 237
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:29,811 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:29,811 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 119
02.12.2021 17:25:29,884 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 120
02.12.2021 17:25:29,899 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 110
02.12.2021 17:25:29,912 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:29,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 18
02.12.2021 17:25:29,921 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119968ms for 120000ms of delay, sleeping for 42ms
02.12.2021 17:25:29,935 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,941 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:29,952 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239790ms for 240000ms of delay, sleeping for 220ms
02.12.2021 17:25:29,972 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119818ms for 120000ms of delay, sleeping for 192ms
02.12.2021 17:25:29,988 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 16
02.12.2021 17:25:29,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:29,998 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:29,998 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:29,999 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 10
02.12.2021 17:25:30,004 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,009 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,009 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,009 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,010 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Committing all active tasks [] and standby tasks [] since 32162ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,010 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,012 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,012 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Committing all active tasks [] and standby tasks [] since 32211ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,110 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:30,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 192
02.12.2021 17:25:30,142 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,167 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119798ms for 120000ms of delay, sleeping for 212ms
02.12.2021 17:25:30,195 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239996ms for 240000ms of delay, sleeping for 14ms
02.12.2021 17:25:30,211 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:30,217 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:30,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 67 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:30,218 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 198290ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:30,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:30,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 198302ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:30,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:30,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:30,230 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967786, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:30,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:30,230 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967796, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:30,232 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:30,233 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:30,233 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,238 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:30,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,239 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 68 iterations.
02.12.2021 17:25:30,241 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239974ms for 240000ms of delay, sleeping for 36ms
02.12.2021 17:25:30,243 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:30,282 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239140ms for 240000ms of delay, sleeping for 870ms
02.12.2021 17:25:30,311 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,313 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:30,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:30,386 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119297ms for 120000ms of delay, sleeping for 713ms
02.12.2021 17:25:30,411 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=641): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:30,411 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=641): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:30,412 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:30,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,412 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=642) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:30,412 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=642) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,assignments=[]}
02.12.2021 17:25:30,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 113
02.12.2021 17:25:30,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 86
02.12.2021 17:25:30,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:30,418 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:30,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,441 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,442 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,450 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=642): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,450 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=642): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,451 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,452 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:30,456 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:30,456 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:30,456 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,456 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,456 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,456 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,456 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,456 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from RUNNING to REBALANCING
02.12.2021 17:25:30,457 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 73
02.12.2021 17:25:30,454 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:30,458 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 58 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:30,460 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:30,460 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:30,460 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:30,460 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:30,461 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:30,461 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:30,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 47
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,510 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,510 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:30,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:30,530 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:30,530 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from REBALANCING to RUNNING
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:30,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:30,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:30,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:30,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:30,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:30,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:30,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:30,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:30,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:30,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:30,716 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59494ms delay out of 60000ms. Remaining 506ms. Executor queue at 0
02.12.2021 17:25:30,717 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58600ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:30,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:30,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:30,744 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:30,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:30,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:30,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:30,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:30,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:30,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:30,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:30,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:30,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:30,914 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:30,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:30,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:30,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:30,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:30,942 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:30,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:30,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:30,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:30,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:30,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:30,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,032 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,032 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,033 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,110 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119968ms for 120000ms of delay, sleeping for 42ms
02.12.2021 17:25:31,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:31,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,115 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,154 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119125ms for 120000ms of delay, sleeping for 885ms
02.12.2021 17:25:31,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239955ms for 240000ms of delay, sleeping for 55ms
02.12.2021 17:25:31,173 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:31,173 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:31,173 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=859) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:31,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:31,216 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:31,222 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239859ms for 240000ms of delay, sleeping for 151ms
02.12.2021 17:25:31,235 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:31,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:31,275 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=859): org.apache.kafka.common.requests.HeartbeatResponse@5e560dea
02.12.2021 17:25:31,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:31,315 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,316 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:31,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:31,375 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239507ms for 240000ms of delay, sleeping for 503ms
02.12.2021 17:25:31,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:31,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:31,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:31,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,444 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,516 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,515 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,517 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:31,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,533 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:31,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:31,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:31,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:31,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:31,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:31,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:31,645 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:31,718 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59601ms delay out of 60000ms. Remaining 399ms. Executor queue at 0
02.12.2021 17:25:31,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:31,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:31,721 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58790ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:31,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:31,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:31,740 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:31,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:31,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:31,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:31,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:31,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:31,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:31,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:31,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:31,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:31,891 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239694ms for 240000ms of delay, sleeping for 316ms
02.12.2021 17:25:31,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:31,921 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:31,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:31,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:31,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:31,945 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:31,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:31,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,017 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,018 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,018 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,018 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,019 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:32,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,044 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119924ms for 120000ms of delay, sleeping for 86ms
02.12.2021 17:25:32,050 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:32,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:32,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:32,129 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 390
02.12.2021 17:25:32,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:32,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 36 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,137 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 60846ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 37 iterations.
02.12.2021 17:25:32,146 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 37 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:32,147 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 60856ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,169 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,182 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=937): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:32,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=189, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:32,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:32,191 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:32,191 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:32,191 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018421, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:32,191 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018431, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:32,192 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=938) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:32,193 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=938): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:32,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 24 ms and fetched 10 records
02.12.2021 17:25:32,193 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:32,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 37 iterations.
02.12.2021 17:25:32,202 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119836ms for 120000ms of delay, sleeping for 174ms
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 68 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 200291ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:32,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 200291ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:32,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:32,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:32,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:32,235 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1197): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:32,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 287
02.12.2021 17:25:32,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:32,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,235 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=58, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:32,244 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:32,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:32,244 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:32,255 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:32,255 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967796, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:32,255 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967806, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:32,255 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1198) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,assignments=[]}
02.12.2021 17:25:32,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 36 ms and fetched 10 records
02.12.2021 17:25:32,257 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:32,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,257 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:32,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 69 iterations.
02.12.2021 17:25:32,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239373ms for 240000ms of delay, sleeping for 637ms
02.12.2021 17:25:32,258 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1198): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:32,264 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=58, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:32,294 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=189, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:32,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:32,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:32,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:32,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,328 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 183
02.12.2021 17:25:32,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 184
02.12.2021 17:25:32,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:32,354 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:32,380 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119470ms for 120000ms of delay, sleeping for 540ms
02.12.2021 17:25:32,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:32,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:32,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 83
02.12.2021 17:25:32,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 83
02.12.2021 17:25:32,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,450 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:32,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:32,511 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,513 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=637) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:32,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 316
02.12.2021 17:25:32,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:32,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@7be74d4f
02.12.2021 17:25:32,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,515 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=637) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:32,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 313
02.12.2021 17:25:32,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 313
02.12.2021 17:25:32,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 436
02.12.2021 17:25:32,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=637): org.apache.kafka.common.requests.HeartbeatResponse@5dacdf79
02.12.2021 17:25:32,516 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:32,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 435
02.12.2021 17:25:32,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 434
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,518 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,519 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 192
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,520 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:32,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 334
02.12.2021 17:25:32,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 213
02.12.2021 17:25:32,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:32,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:32,636 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:32,712 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,712 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,712 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=653) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:32,712 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:32,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,712 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 189 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,712 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:32,713 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=653) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=189,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:32,713 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@79bce06f
02.12.2021 17:25:32,715 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,715 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:32,715 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,715 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 305
02.12.2021 17:25:32,715 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,716 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=654) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 303
02.12.2021 17:25:32,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 234
02.12.2021 17:25:32,718 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@cade851
02.12.2021 17:25:32,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 112
02.12.2021 17:25:32,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,719 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:32,720 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 189 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:32,721 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59790ms delay out of 60000ms. Remaining 210ms. Executor queue at 0
02.12.2021 17:25:32,721 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:32,724 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:32,724 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:32,724 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=654) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:32,724 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59817ms for 60000ms of delay, sleeping for 193ms
02.12.2021 17:25:32,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:32,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:32,812 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,815 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:32,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 131
02.12.2021 17:25:32,819 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 9
02.12.2021 17:25:32,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:32,829 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:32,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:32,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:32,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238906ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:32,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:32,920 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59160ms for 60000ms of delay, sleeping for 850ms
02.12.2021 17:25:32,921 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119325ms for 120000ms of delay, sleeping for 685ms
02.12.2021 17:25:32,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:32,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:32,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:32,951 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:32,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:32,955 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,020 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 391
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,021 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 375
02.12.2021 17:25:33,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 291
02.12.2021 17:25:33,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:33,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 275
02.12.2021 17:25:33,161 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:33,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 187
02.12.2021 17:25:33,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:33,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 167
02.12.2021 17:25:33,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:33,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,330 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,330 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 67
02.12.2021 17:25:33,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:33,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,412 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,413 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,413 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=643) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:33,413 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 124
02.12.2021 17:25:33,413 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@36268594
02.12.2021 17:25:33,413 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,414 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:33,414 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,414 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,414 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 31, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,414 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=644) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,415 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 122
02.12.2021 17:25:33,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:33,416 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:33,416 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,416 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=643) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:33,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 105
02.12.2021 17:25:33,416 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@39822b30
02.12.2021 17:25:33,416 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:33,416 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 58 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:33,416 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:33,416 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:33,417 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 31, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:33,417 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=644) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:33,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 104
02.12.2021 17:25:33,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,455 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,456 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,456 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,516 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,521 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:33,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:33,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:33,614 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119452ms for 120000ms of delay, sleeping for 558ms
02.12.2021 17:25:33,633 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,657 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:33,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:33,758 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:33,772 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57531ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:33,831 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:33,831 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:33,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:33,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 239906ms delay out of 240000ms. Remaining 94ms. Executor queue at 0
02.12.2021 17:25:33,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239807ms for 240000ms of delay, sleeping for 203ms
02.12.2021 17:25:33,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:33,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:33,958 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,023 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,023 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,024 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:34,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,129 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239769ms for 240000ms of delay, sleeping for 241ms
02.12.2021 17:25:34,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:34,159 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,184 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:34,184 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:34,184 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=860) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:34,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 37 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,195 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 62904ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 38 iterations.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 38 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 62912ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:34,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,203 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:34,205 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:34,205 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:34,205 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 81, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:34,205 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=939) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:34,205 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018431, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:34,206 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018441, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:34,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 3 ms and fetched 10 records
02.12.2021 17:25:34,206 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:34,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,206 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,206 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 38 iterations.
02.12.2021 17:25:34,217 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119999ms for 120000ms of delay, sleeping for 11ms
02.12.2021 17:25:34,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:34,265 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:34,277 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119911ms for 120000ms of delay, sleeping for 99ms
02.12.2021 17:25:34,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=860): org.apache.kafka.common.requests.HeartbeatResponse@5f3b4eca
02.12.2021 17:25:34,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:34,300 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:34,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:34,374 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239458ms for 240000ms of delay, sleeping for 552ms
02.12.2021 17:25:34,386 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119856ms for 120000ms of delay, sleeping for 154ms
02.12.2021 17:25:34,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:34,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,459 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,523 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,523 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,524 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:34,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:34,542 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119377ms for 120000ms of delay, sleeping for 633ms
02.12.2021 17:25:34,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:34,661 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:34,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:34,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:34,772 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58531ms delay out of 60000ms. Remaining 1469ms. Executor queue at 0
02.12.2021 17:25:34,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 15 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:34,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:34,776 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:34,777 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149009, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:34,777 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149019, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:34,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:34,777 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:34,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:34,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 16 iterations.
02.12.2021 17:25:34,778 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 57994ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:34,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:34,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,832 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:34,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,832 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:34,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:34,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:34,833 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:34,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:34,928 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239005ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:34,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:34,960 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:34,960 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,024 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,025 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,040 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:35,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 185
02.12.2021 17:25:35,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:35,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119998ms for 120000ms of delay, sleeping for 12ms
02.12.2021 17:25:35,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 38 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 63929ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 39 iterations.
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 39 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 63930ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:35,221 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018441, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:35,221 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018451, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:35,221 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 39 iterations.
02.12.2021 17:25:35,225 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119795ms for 120000ms of delay, sleeping for 215ms
02.12.2021 17:25:35,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 77
02.12.2021 17:25:35,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:35,272 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,272 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 58 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:35,272 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1199) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=58,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:35,333 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,334 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,337 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,338 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 173
02.12.2021 17:25:35,366 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:35,372 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1199): org.apache.kafka.common.requests.HeartbeatResponse@e15ac04
02.12.2021 17:25:35,372 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:35,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 72
02.12.2021 17:25:35,442 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119663ms for 120000ms of delay, sleeping for 347ms
02.12.2021 17:25:35,460 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,461 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 53
02.12.2021 17:25:35,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:35,511 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,511 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,511 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=638) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:35,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 327
02.12.2021 17:25:35,512 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=638): org.apache.kafka.common.requests.HeartbeatResponse@3c11d51b
02.12.2021 17:25:35,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:35,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 326
02.12.2021 17:25:35,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:35,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:35,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=638) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:35,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 447
02.12.2021 17:25:35,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=638): org.apache.kafka.common.requests.HeartbeatResponse@45176a04
02.12.2021 17:25:35,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:35,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 446
02.12.2021 17:25:35,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 446
02.12.2021 17:25:35,525 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,526 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,542 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,542 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:35,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 225
02.12.2021 17:25:35,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 346
02.12.2021 17:25:35,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:35,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 245
02.12.2021 17:25:35,778 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 58994ms delay out of 60000ms. Remaining 1006ms. Executor queue at 1
02.12.2021 17:25:35,779 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58977ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:35,812 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119569ms for 120000ms of delay, sleeping for 441ms
02.12.2021 17:25:35,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 23
02.12.2021 17:25:35,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 143
02.12.2021 17:25:35,839 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:35,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,848 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:35,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:35,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:35,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:35,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 43
02.12.2021 17:25:35,943 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239977ms for 240000ms of delay, sleeping for 33ms
02.12.2021 17:25:35,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:35,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:35,965 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:35,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:35,965 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:35,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:35,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:35,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:35,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:35,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:35,989 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239835ms for 240000ms of delay, sleeping for 175ms
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,027 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,028 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,035 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,052 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 283
02.12.2021 17:25:36,071 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=654): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:36,112 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:36,113 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=655) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:36,112 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=654): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:36,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 403
02.12.2021 17:25:36,124 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:36,136 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:36,136 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:36,148 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:36,165 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=655) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:36,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 371
02.12.2021 17:25:36,172 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 69 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 204247ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:36,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 204247ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:36,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:36,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:36,176 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Rebalance failed.
02.12.2021 17:25:36,176 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:36,176 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:36,176 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 31, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 5])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:36,176 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1200) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:36,176 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967806, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:36,176 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967816, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:36,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:36,177 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:36,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,177 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:36,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,177 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 70 iterations.
02.12.2021 17:25:36,178 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239982ms for 240000ms of delay, sleeping for 28ms
02.12.2021 17:25:36,169 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:36,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239874ms for 240000ms of delay, sleeping for 136ms
02.12.2021 17:25:36,214 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=655): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,214 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=655): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,231 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:36,232 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:36,232 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,232 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,232 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,232 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,232 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,232 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:36,232 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:36,231 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:36,233 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:36,241 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 190 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:36,241 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:36,263 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:36,263 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:36,265 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119006ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:36,263 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:36,269 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:36,269 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:36,275 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:36,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:36,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 305
02.12.2021 17:25:36,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:36,333 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:36,355 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:36,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,356 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,358 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,358 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,359 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239394ms for 240000ms of delay, sleeping for 616ms
02.12.2021 17:25:36,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:36,380 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 156
02.12.2021 17:25:36,433 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:36,458 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:36,470 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,471 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 55
02.12.2021 17:25:36,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,527 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,527 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,528 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,528 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,528 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,536 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:36,537 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:36,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 499
02.12.2021 17:25:36,537 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:36,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:36,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 398
02.12.2021 17:25:36,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:36,659 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:36,673 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:36,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:36,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:36,760 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:36,773 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:36,779 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59977ms delay out of 60000ms. Remaining 23ms. Executor queue at 1
02.12.2021 17:25:36,780 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59730ms for 60000ms of delay, sleeping for 280ms
02.12.2021 17:25:36,832 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:36,838 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:36,860 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:36,860 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,875 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:36,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:36,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:36,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:36,972 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:36,972 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:36,978 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239186ms for 240000ms of delay, sleeping for 824ms
02.12.2021 17:25:37,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,029 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,029 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,030 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,036 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,065 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59803ms for 60000ms of delay, sleeping for 207ms
02.12.2021 17:25:37,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:37,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:37,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:37,196 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:37,212 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:37,212 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=861) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:37,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:37,263 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:37,269 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119201ms for 120000ms of delay, sleeping for 809ms
02.12.2021 17:25:37,273 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,274 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59438ms for 60000ms of delay, sleeping for 572ms
02.12.2021 17:25:37,316 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=861): org.apache.kafka.common.requests.HeartbeatResponse@706b42c6
02.12.2021 17:25:37,316 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:37,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:37,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:37,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,361 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,361 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:37,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,440 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:37,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,473 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,473 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,530 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,531 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,537 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,538 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:37,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,538 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,538 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:37,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,573 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:37,631 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,638 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:37,662 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:37,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:37,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:37,775 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=644): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:37,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:37,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,775 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:37,776 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,775 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=644): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:37,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:37,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:37,777 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:37,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:37,777 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=645) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 261
02.12.2021 17:25:37,774 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:37,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:37,776 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=645) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:37,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 276
02.12.2021 17:25:37,805 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239860ms for 240000ms of delay, sleeping for 150ms
02.12.2021 17:25:37,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:37,840 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 517 ms and fetched 0 records
02.12.2021 17:25:37,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,879 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:37,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:37,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:37,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:37,879 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:37,883 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,894 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 16 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:37,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:37,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:37,896 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149019, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:37,896 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149029, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:37,896 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:37,903 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:37,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,903 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:37,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 17 iterations.
02.12.2021 17:25:37,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58888ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:37,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 98
02.12.2021 17:25:37,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:37,958 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239721ms for 240000ms of delay, sleeping for 289ms
02.12.2021 17:25:37,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:37,974 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:37,975 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:37,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:37,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:37,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:37,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:37,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:37,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:37,984 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,044 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,060 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,061 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,061 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,085 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:38,088 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119884ms for 120000ms of delay, sleeping for 126ms
02.12.2021 17:25:38,146 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,153 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 392
02.12.2021 17:25:38,178 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:38,188 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:38,219 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119644ms for 120000ms of delay, sleeping for 366ms
02.12.2021 17:25:38,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:38,251 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239418ms for 240000ms of delay, sleeping for 592ms
02.12.2021 17:25:38,260 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 284
02.12.2021 17:25:38,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:38,299 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:38,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,360 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 184
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,383 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,384 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 127
02.12.2021 17:25:38,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:38,447 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:38,460 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,475 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 39
02.12.2021 17:25:38,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 27
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,512 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=639) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 372
02.12.2021 17:25:38,512 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=639): org.apache.kafka.common.requests.HeartbeatResponse@87a4094
02.12.2021 17:25:38,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 372
02.12.2021 17:25:38,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 372
02.12.2021 17:25:38,515 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:38,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:38,515 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=639) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:38,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 460
02.12.2021 17:25:38,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=639): org.apache.kafka.common.requests.HeartbeatResponse@2efde914
02.12.2021 17:25:38,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:38,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 460
02.12.2021 17:25:38,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 460
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,540 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,546 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:38,561 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:38,595 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119782ms for 120000ms of delay, sleeping for 228ms
02.12.2021 17:25:38,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 271
02.12.2021 17:25:38,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 359
02.12.2021 17:25:38,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:38,713 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 171
02.12.2021 17:25:38,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:38,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:38,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:38,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 70
02.12.2021 17:25:38,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 158
02.12.2021 17:25:38,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 39 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 67535ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 40 iterations.
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 40 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 67535ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=939): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=190, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:38,826 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:38,826 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018451, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:38,827 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018461, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:38,826 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=940) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:38,827 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 40 iterations.
02.12.2021 17:25:38,828 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119700ms for 120000ms of delay, sleeping for 310ms
02.12.2021 17:25:38,844 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239874ms for 240000ms of delay, sleeping for 136ms
02.12.2021 17:25:38,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:38,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:38,886 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:38,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,912 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59888ms delay out of 60000ms. Remaining 112ms. Executor queue at 0
02.12.2021 17:25:38,917 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59187ms for 60000ms of delay, sleeping for 823ms
02.12.2021 17:25:38,918 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:38,927 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=940): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:38,927 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=190, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:38,950 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 96
02.12.2021 17:25:38,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:38,975 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:38,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:38,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:38,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 70 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 207055ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,984 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:38,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:38,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:38,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 207057ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:38,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:38,987 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:38,987 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1200): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=59, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:38,991 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:38,991 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=967816, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:38,991 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=967826, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1201) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,assignments=[]}
02.12.2021 17:25:38,991 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:38,992 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-5, new queue size is 10
02.12.2021 17:25:38,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:38,992 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:38,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:38,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 71 iterations.
02.12.2021 17:25:38,992 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239955ms for 240000ms of delay, sleeping for 55ms
02.12.2021 17:25:39,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,042 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,043 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 89
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,048 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 64
02.12.2021 17:25:39,052 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239451ms for 240000ms of delay, sleeping for 559ms
02.12.2021 17:25:39,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,064 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,065 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,090 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:39,112 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,112 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,113 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=656) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:39,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 436
02.12.2021 17:25:39,127 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@54b8f8da
02.12.2021 17:25:39,130 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:39,130 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:39,130 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:39,130 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:39,130 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,130 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=657) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:39,136 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:39,148 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 190 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 418
02.12.2021 17:25:39,148 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=656) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=190,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:39,151 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 411
02.12.2021 17:25:39,151 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=656): org.apache.kafka.common.requests.HeartbeatResponse@319fd815
02.12.2021 17:25:39,153 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:39,152 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119993ms for 120000ms of delay, sleeping for 17ms
02.12.2021 17:25:39,155 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 190 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:39,163 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:39,165 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:39,165 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:39,171 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=657) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:39,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 374
02.12.2021 17:25:39,177 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119961ms for 120000ms of delay, sleeping for 49ms
02.12.2021 17:25:39,177 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:39,226 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,227 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119194ms for 120000ms of delay, sleeping for 816ms
02.12.2021 17:25:39,251 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:39,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:39,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:39,378 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:39,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,387 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,387 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,388 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,476 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,545 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,548 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,549 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,566 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,566 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:39,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,568 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:39,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:39,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,615 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239691ms for 240000ms of delay, sleeping for 319ms
02.12.2021 17:25:39,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:39,692 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:39,743 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59649ms for 60000ms of delay, sleeping for 361ms
02.12.2021 17:25:39,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:39,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:39,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:39,899 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:39,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:39,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:39,937 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239759ms for 240000ms of delay, sleeping for 251ms
02.12.2021 17:25:39,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:39,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:39,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:40,047 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,048 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119753ms for 120000ms of delay, sleeping for 257ms
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,048 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,055 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:40,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:40,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,079 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,111 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59060ms for 60000ms of delay, sleeping for 950ms
02.12.2021 17:25:40,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:40,209 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:40,216 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239101ms for 240000ms of delay, sleeping for 909ms
02.12.2021 17:25:40,221 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,224 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:40,224 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=862) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:40,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:40,307 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119991ms for 120000ms of delay, sleeping for 19ms
02.12.2021 17:25:40,310 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:40,324 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=862): org.apache.kafka.common.requests.HeartbeatResponse@10201cc1
02.12.2021 17:25:40,324 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:40,328 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119744ms for 120000ms of delay, sleeping for 266ms
02.12.2021 17:25:40,389 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,404 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,479 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,480 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 221
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,570 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,570 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 205
02.12.2021 17:25:40,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:40,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:40,606 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119654ms for 120000ms of delay, sleeping for 356ms
02.12.2021 17:25:40,605 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:40,682 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:40,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:40,775 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,775 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,775 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=646) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:40,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:40,778 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:40,778 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:40,778 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=646) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:40,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 277
02.12.2021 17:25:40,782 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:40,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:40,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:40,904 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:40,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:40,965 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119737ms for 120000ms of delay, sleeping for 273ms
02.12.2021 17:25:40,981 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:40,983 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:40,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,005 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:41,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,055 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,057 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,057 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,069 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59932ms for 60000ms of delay, sleeping for 78ms
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 397
02.12.2021 17:25:41,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,093 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,094 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,094 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,105 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:41,135 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239965ms for 240000ms of delay, sleeping for 45ms
02.12.2021 17:25:41,156 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58979ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:41,181 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239312ms for 240000ms of delay, sleeping for 698ms
02.12.2021 17:25:41,189 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:41,208 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 40 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 69949ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 41 iterations.
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 41 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 69949ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,240 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:41,240 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:41,240 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 82, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:41,241 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=941) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:41,245 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018461, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:41,245 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018471, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:41,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:41,245 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:41,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,246 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:41,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 41 iterations.
02.12.2021 17:25:41,246 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119158ms for 120000ms of delay, sleeping for 852ms
02.12.2021 17:25:41,250 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:41,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:41,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:41,390 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,404 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,405 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:41,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:41,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,484 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 31
02.12.2021 17:25:41,502 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=657): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:41,502 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:41,502 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,502 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:41,502 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=658) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,502 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=657): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:41,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 54
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:41,503 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:41,503 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=658) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:41,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 90
02.12.2021 17:25:41,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:41,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,512 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,513 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,513 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,513 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=640) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:41,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:41,513 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:41,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@770e8f30
02.12.2021 17:25:41,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 390
02.12.2021 17:25:41,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 390
02.12.2021 17:25:41,515 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:41,515 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=640) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:41,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 469
02.12.2021 17:25:41,518 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=640): org.apache.kafka.common.requests.HeartbeatResponse@2b326b1e
02.12.2021 17:25:41,518 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:41,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 466
02.12.2021 17:25:41,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 465
02.12.2021 17:25:41,532 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=658): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,532 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,532 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:41,532 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=658): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,532 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:41,532 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,533 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:41,533 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,533 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,533 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,533 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,533 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,534 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,534 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,534 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 25
02.12.2021 17:25:41,533 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 191 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:41,534 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:41,534 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,534 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,535 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:41,535 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,535 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:41,535 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 62
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,559 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,559 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,559 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,560 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,560 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,572 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:41,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:41,597 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:41,601 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:41,601 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:41,601 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:41,607 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:41,607 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:41,607 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:41,609 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:41,609 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:41,609 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:41,612 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:41,614 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:41,614 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:41,619 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 365
02.12.2021 17:25:41,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:41,715 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:41,719 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 265
02.12.2021 17:25:41,720 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:41,762 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 298
02.12.2021 17:25:41,801 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=645): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,801 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,802 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=645): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,805 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,807 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@7511b47f
02.12.2021 17:25:41,807 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,807 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@2e5a03a0
02.12.2021 17:25:41,807 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:41,808 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:41,808 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,808 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,808 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,808 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,808 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,809 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from RUNNING to REBALANCING
02.12.2021 17:25:41,809 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 255
02.12.2021 17:25:41,808 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:41,809 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:41,809 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:41,809 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,809 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:41,810 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,810 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:41,810 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:41,810 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:41,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 271
02.12.2021 17:25:41,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:41,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 164
02.12.2021 17:25:41,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:41,862 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 71 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 209961ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_5] and standby tasks [] since 209961ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:41,889 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:41,890 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1201): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 4, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,890 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 4, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:41,890 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=59, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:41,890 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 59 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16
02.12.2021 17:25:41,894 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:41,897 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:307] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Revoke previously assigned partitions redacted.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:41,897 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:74] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Current state RUNNING: revoked partitions [redacted.Cloud.Message.Callback.Retry3-5] because of consumer rebalance.
02.12.2021 17:25:41,897 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State transition from RUNNING to PARTITIONS_REVOKED
02.12.2021 17:25:41,897 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Flushing record collector
02.12.2021 17:25:41,898 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Prepared RUNNING task for committing
02.12.2021 17:25:41,898 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry3-5=OffsetAndMetadata{offset=967826, leaderEpoch=null, metadata='AQAAAX1785lt'}} to coordinator kafka-5.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:41,898 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1202) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition_index=5,committed_offset=967826,committed_leader_epoch=-1,committed_metadata=AQAAAX1785lt}]}]}
02.12.2021 17:25:41,909 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 151
02.12.2021 17:25:41,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 161
02.12.2021 17:25:41,909 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:41,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:41,913 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,916 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_COMMIT response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1202): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry3', partitions=[OffsetCommitResponsePartition(partitionIndex=5, errorCode=0)])])
02.12.2021 17:25:41,920 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Committed offset 967826 for partition redacted.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:41,929 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry3-5=967825}
02.12.2021 17:25:41,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:41,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 187
02.12.2021 17:25:41,929 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:602] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Writing checkpoint: {}
02.12.2021 17:25:41,936 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Finalized commit for RUNNING task with eos false enforce checkpoint true
02.12.2021 17:25:41,937 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:297] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Closing processor topology
02.12.2021 17:25:41,939 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Source.s.destroy
02.12.2021 17:25:41,941 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Source.s.create
02.12.2021 17:25:41,947 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Source.s.punctuate
02.12.2021 17:25:41,951 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-rate, group=stream-processor-node-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-total, group=stream-processor-node-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Source.s.process
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Source}]
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Source.s.Source-record-e2e-latency
02.12.2021 17:25:41,955 INFO [com.sigfox.kafka.throttleable.ThrottleableStreamProcessor:89] Stream 'staging-message-processor-retry3' task '0_5': pausable processor closing
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.destroy
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.create
02.12.2021 17:25:41,955 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.punctuate
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.ThrottleableProcessor.s.process
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Processor.s.destroy
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Processor.s.create
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Processor.s.punctuate
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Processor.s.process
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Processor}]
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Processor}]
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5, processor-node-id=Processor}]
02.12.2021 17:25:41,956 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.node.Processor.s.Processor-record-e2e-latency
02.12.2021 17:25:41,956 INFO [org.apache.kafka.streams.processor.internals.StreamTask:278] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Suspended running
02.12.2021 17:25:41,956 INFO [org.apache.kafka.streams.processor.internals.StreamThread:87] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] partition revocation took 59 ms.
02.12.2021 17:25:41,956 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:411] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Need to revoke partitions [redacted.Cloud.Message.Callback.Retry3-5] and re-join the group
02.12.2021 17:25:41,956 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-4], userDataSize=48)
02.12.2021 17:25:41,957 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:41,957 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:384] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Skipped preparing SUSPENDED task for commit since there is nothing to commit
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-rate, group=stream-task-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-total, group=stream-task-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.process
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-lateness-avg, group=stream-task-metrics, description=The observed average lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=record-lateness-max, group=stream-task-metrics, description=The observed maximum lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.record-lateness
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=active-buffer-count, group=stream-task-metrics, description=The count of buffered records that are polled from consumer and not yet processed for this active task, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.active-buffer-count
02.12.2021 17:25:41,957 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-latency-avg, group=stream-task-metrics, description=The average latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,958 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-latency-max, group=stream-task-metrics, description=The maximum latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,958 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-rate, group=stream-task-metrics, description=The average number of calls to punctuate per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,958 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=punctuate-total, group=stream-task-metrics, description=The total number of calls to punctuate, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,958 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.punctuate
02.12.2021 17:25:41,961 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-latency-avg, group=stream-task-metrics, description=The average latency of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,961 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=process-latency-max, group=stream-task-metrics, description=The maximum latency of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,961 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.process-latency
02.12.2021 17:25:41,961 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=active-process-ratio, group=stream-task-metrics, description=The fraction of time the thread spent on processing this task among all assigned active tasks, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,965 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.active-process-ratio
02.12.2021 17:25:41,963 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:41,965 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=enforced-processing-rate, group=stream-task-metrics, description=The average number of occurrences of enforced-processing operations per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,971 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=enforced-processing-total, group=stream-task-metrics, description=The total number of occurrences of enforced-processing operations, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,975 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.enforced-processing
02.12.2021 17:25:41,975 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=dropped-records-rate, group=stream-task-metrics, description=The average number of dropped records per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,985 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:41,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:41,995 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:41,987 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=dropped-records-total, group=stream-task-metrics, description=The total number of dropped records, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_5}]
02.12.2021 17:25:41,996 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_5.s.dropped-records
02.12.2021 17:25:41,995 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:41,998 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:41,998 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:41,996 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:127] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Closing state manager for ACTIVE task 0_5
02.12.2021 17:25:41,999 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1203) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:42,014 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 60
02.12.2021 17:25:42,009 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 51
02.12.2021 17:25:42,007 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:515] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Closing its state manager and all the registered state stores: {}
02.12.2021 17:25:42,017 INFO [org.apache.kafka.clients.consumer.KafkaConsumer:1070] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions
02.12.2021 17:25:42,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 81
02.12.2021 17:25:42,034 INFO [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:258] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Closing record collector clean
02.12.2021 17:25:42,040 INFO [org.apache.kafka.streams.processor.internals.StreamTask:493] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_5] Closed clean
02.12.2021 17:25:42,041 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:192] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Created state store manager for task 0_4
02.12.2021 17:25:42,043 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.dropped-records
02.12.2021 17:25:42,043 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=dropped-records-rate, group=stream-task-metrics, description=The average number of dropped records per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,043 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=dropped-records-total, group=stream-task-metrics, description=The total number of dropped records, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,043 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.enforced-processing
02.12.2021 17:25:42,046 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=enforced-processing-rate, group=stream-task-metrics, description=The average number of occurrences of enforced-processing operations per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,049 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=enforced-processing-total, group=stream-task-metrics, description=The total number of occurrences of enforced-processing operations, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,050 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.active-process-ratio
02.12.2021 17:25:42,050 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=active-process-ratio, group=stream-task-metrics, description=The fraction of time the thread spent on processing this task among all assigned active tasks, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,060 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.process-latency
02.12.2021 17:25:42,060 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-latency-avg, group=stream-task-metrics, description=The average latency of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-latency-max, group=stream-task-metrics, description=The maximum latency of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.punctuate
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-latency-avg, group=stream-task-metrics, description=The average latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-latency-max, group=stream-task-metrics, description=The maximum latency of calls to punctuate, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-rate, group=stream-task-metrics, description=The average number of calls to punctuate per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=punctuate-total, group=stream-task-metrics, description=The total number of calls to punctuate, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.active-buffer-count
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=active-buffer-count, group=stream-task-metrics, description=The count of buffered records that are polled from consumer and not yet processed for this active task, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Processor.s.Processor-record-e2e-latency
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Processor}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Processor}]
02.12.2021 17:25:42,061 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Processor}]
02.12.2021 17:25:42,066 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Source.s.Source-record-e2e-latency
02.12.2021 17:25:42,066 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-avg, group=stream-processor-node-metrics, description=The average end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Source}]
02.12.2021 17:25:42,066 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-max, group=stream-processor-node-metrics, description=The maximum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Source}]
02.12.2021 17:25:42,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:42,067 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,068 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:42,069 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:42,069 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,069 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:42,069 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,070 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,070 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,066 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-e2e-latency-min, group=stream-processor-node-metrics, description=The minimum end-to-end latency of a record, measuring by comparing the record timestamp with the system time when it has been fully processed by the node, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Source}]
02.12.2021 17:25:42,072 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.record-lateness
02.12.2021 17:25:42,074 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-lateness-avg, group=stream-task-metrics, description=The observed average lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,077 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=record-lateness-max, group=stream-task-metrics, description=The observed maximum lateness of records in milliseconds, measured by comparing the record timestamp with the current stream time, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:42,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:42,090 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,090 DEBUG [org.apache.kafka.streams.processor.internals.ProcessorStateManager:208] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Register global stores []
02.12.2021 17:25:42,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:42,093 TRACE [org.apache.kafka.streams.processor.internals.StreamThread:246] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Created task 0_4 with assigned partitions [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:42,101 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: redacted.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:42,102 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED
02.12.2021 17:25:42,103 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119220ms for 120000ms of delay, sleeping for 790ms
02.12.2021 17:25:42,113 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1203): org.apache.kafka.common.requests.HeartbeatResponse@783f5bbf
02.12.2021 17:25:42,113 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:42,102 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:42,114 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:42,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,121 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,121 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,114 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16
02.12.2021 17:25:42,126 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:42,126 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:42,142 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 4])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:42,157 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59980ms delay out of 60000ms. Remaining 20ms. Executor queue at 0
02.12.2021 17:25:42,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 17 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,153 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1204) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:42,159 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:42,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 31307ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.RecordCollectorImpl:247] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Flushing record collector
02.12.2021 17:25:42,163 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:673] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Not returning fetched records for partition redacted.Cloud.Message.Callback.Retry3-5 since it is no longer assigned
02.12.2021 17:25:42,167 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:719] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Draining fetched records for partition redacted.Cloud.Message.Callback.Retry3-5
02.12.2021 17:25:42,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:381] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Prepared RUNNING task for committing
02.12.2021 17:25:42,168 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,167 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lag, group=consumer-fetch-manager-metrics, description=The latest lag of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lag-max, group=consumer-fetch-manager-metrics, description=The max lag of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lag-avg, group=consumer-fetch-manager-metrics, description=The average lag of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name redacted.Cloud.Message.Callback.Retry3-5.records-lag
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lead, group=consumer-fetch-manager-metrics, description=The latest lead of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lead-min, group=consumer-fetch-manager-metrics, description=The min lead of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=records-lead-avg, group=consumer-fetch-manager-metrics, description=The average lead of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:463] Removed sensor with name redacted.Cloud.Message.Callback.Retry3-5.records-lead
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:553] Removed metric named MetricName [name=preferred-read-replica, group=consumer-fetch-manager-metrics, description=The current read replica for the partition, or -1 if reading from leader, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=5}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=preferred-read-replica, group=consumer-fetch-manager-metrics, description=The current read replica for the partition, or -1 if reading from leader, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:42,173 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 226
02.12.2021 17:25:42,171 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,169 TRACE [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1157] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OffsetCommit request with {redacted.Cloud.Message.Callback.Retry1-7=OffsetAndMetadata{offset=1149029, leaderEpoch=null, metadata='AQAAAX179lnB'}} to coordinator kafka-4.data.sta.par.eu.dc.sigfox.com:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:42,176 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending OFFSET_COMMIT request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=863) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null,topics=[{name=redacted.Cloud.Message.Callback.Retry1,partitions=[{partition_index=7,committed_offset=1149029,committed_leader_epoch=-1,committed_metadata=AQAAAX179lnB}]}]}
02.12.2021 17:25:42,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:42,196 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received OFFSET_COMMIT response from node 2147483644 for request with header RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=7, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=863): OffsetCommitResponseData(throttleTimeMs=0, topics=[OffsetCommitResponseTopic(name='redacted.Cloud.Message.Callback.Retry1', partitions=[OffsetCommitResponsePartition(partitionIndex=7, errorCode=0)])])
02.12.2021 17:25:42,196 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1185] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Committed offset 1149029 for partition redacted.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:42,197 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:42,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:808] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Checkpointable offsets {redacted.Cloud.Message.Callback.Retry1-7=1149028}
02.12.2021 17:25:42,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:465] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Finalized commit for RUNNING task with eos false enforce checkpoint false
02.12.2021 17:25:42,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:684] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Committed all active tasks [0_7] and standby tasks [] in 0ms
02.12.2021 17:25:42,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:42,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:42,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:42,209 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149029, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:42,210 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149039, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:42,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:42,215 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:42,215 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,215 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:42,216 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,214 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:42,213 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:42,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 8 iterations.
02.12.2021 17:25:42,221 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,232 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59784ms for 60000ms of delay, sleeping for 226ms
02.12.2021 17:25:42,269 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:42,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 297
02.12.2021 17:25:42,297 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:42,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:42,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:42,370 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 198
02.12.2021 17:25:42,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:42,397 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:42,399 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:42,399 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:42,400 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:42,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:42,400 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:42,400 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:42,400 INFO [org.apache.kafka.streams.processor.internals.StreamTask:218] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Initialized
02.12.2021 17:25:42,401 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetching committed offsets for partitions: [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:42,402 TRACE [org.apache.kafka.common.requests.OffsetFetchRequest:93] Fallback the requireStable flag to false as broker only supports OffsetFetchRequest version 5. Need v7 or newer to enable this feature
02.12.2021 17:25:42,402 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_FETCH request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1205) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partition_indexes=[4]}]}
02.12.2021 17:25:42,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:42,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,420 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,420 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,426 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 195
02.12.2021 17:25:42,464 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59396ms for 60000ms of delay, sleeping for 614ms
02.12.2021 17:25:42,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:42,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:42,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,495 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,495 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,497 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:42,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 95
02.12.2021 17:25:42,568 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,569 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,569 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,571 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,571 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,596 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:42,593 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:42,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,599 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,599 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,600 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,601 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:42,621 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,622 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,623 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:42,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,672 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:42,701 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:42,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:42,721 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:42,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:42,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:42,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:42,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:42,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 300
02.12.2021 17:25:42,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:42,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:42,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:42,898 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119691ms for 120000ms of delay, sleeping for 319ms
02.12.2021 17:25:42,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:42,904 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:42,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:42,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:42,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:42,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:42,923 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:42,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:42,923 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 200
02.12.2021 17:25:42,970 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:42,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:42,996 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:42,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 89
02.12.2021 17:25:43,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:43,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,071 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,070 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,074 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,074 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,097 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:43,107 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59084ms for 60000ms of delay, sleeping for 926ms
02.12.2021 17:25:43,109 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,123 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:43,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,123 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,179 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:43,198 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:43,223 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119838ms for 120000ms of delay, sleeping for 172ms
02.12.2021 17:25:43,224 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:43,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:43,230 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,230 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:43,230 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=864) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:43,232 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:43,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 297
02.12.2021 17:25:43,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:43,306 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:43,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:43,325 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,331 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=864): org.apache.kafka.common.requests.HeartbeatResponse@7ef77a72
02.12.2021 17:25:43,331 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:43,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:43,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 197
02.12.2021 17:25:43,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:43,397 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119519ms for 120000ms of delay, sleeping for 491ms
02.12.2021 17:25:43,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:43,423 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,424 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:43,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:43,477 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 97
02.12.2021 17:25:43,480 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:43,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,498 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:43,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 99
02.12.2021 17:25:43,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:43,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,574 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 203
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:43,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:43,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,598 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:43,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,629 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,630 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 145
02.12.2021 17:25:43,626 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:43,632 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,642 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,643 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,643 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:43,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:43,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 396
02.12.2021 17:25:43,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:43,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:43,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 44
02.12.2021 17:25:43,746 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 397
02.12.2021 17:25:43,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,776 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,777 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,777 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=647) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:43,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 354
02.12.2021 17:25:43,780 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=647): org.apache.kafka.common.requests.HeartbeatResponse@59047e54
02.12.2021 17:25:43,780 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,780 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:43,780 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,780 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,780 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,780 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=648) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,780 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 350
02.12.2021 17:25:43,781 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:43,779 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:43,784 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 59 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,784 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=647) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=59,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:43,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:43,787 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=647): org.apache.kafka.common.requests.HeartbeatResponse@66087a8a
02.12.2021 17:25:43,788 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:43,788 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinPrepare with generation 59 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:43,788 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] (Re-)joining group
02.12.2021 17:25:43,788 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry3]
02.12.2021 17:25:43,789 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry3', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, -49, -35, 46, -67, -91, 11, 64, -19, -112, 118, 54, -49, 99, -2, 91, 66, 0, 0, 0, 0, 0, 0, 0, 0, 32, 0, 0, 0, 0])])) to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:43,800 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:43,795 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=648) and timeout 305000 to node 2147483643: {group_id=staging-message-processor-retry3,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:43,803 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 272
02.12.2021 17:25:43,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:43,847 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 296
02.12.2021 17:25:43,877 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,881 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:43,885 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Disabling heartbeat thread
02.12.2021 17:25:43,896 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119943ms for 120000ms of delay, sleeping for 67ms
02.12.2021 17:25:43,900 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:43,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:43,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:43,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 196
02.12.2021 17:25:43,968 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119695ms for 120000ms of delay, sleeping for 315ms
02.12.2021 17:25:43,982 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 93
02.12.2021 17:25:43,999 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,000 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,008 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,008 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,011 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:44,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:44,035 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59213ms for 60000ms of delay, sleeping for 797ms
02.12.2021 17:25:44,052 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:44,076 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,078 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,075 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,078 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,081 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 421
02.12.2021 17:25:44,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:44,126 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:44,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,132 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,144 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,144 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 359
02.12.2021 17:25:44,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 315
02.12.2021 17:25:44,215 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:44,231 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:44,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 259
02.12.2021 17:25:44,286 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119835ms for 120000ms of delay, sleeping for 175ms
02.12.2021 17:25:44,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 214
02.12.2021 17:25:44,315 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:44,332 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:44,345 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 158
02.12.2021 17:25:44,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 114
02.12.2021 17:25:44,416 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,425 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,425 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 88
02.12.2021 17:25:44,445 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 58
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 41 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 73171ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 42 iterations.
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 42 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 73171ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:44,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=941): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=191, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:44,463 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:44,463 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018471, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:44,463 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018481, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=942) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:44,463 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 42 iterations.
02.12.2021 17:25:44,464 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119925ms for 120000ms of delay, sleeping for 85ms
02.12.2021 17:25:44,464 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=942): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:44,464 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=191, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:44,489 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 13
02.12.2021 17:25:44,502 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,502 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,502 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,502 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=659) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:44,503 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 79
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=659): org.apache.kafka.common.requests.HeartbeatResponse@5bf6763b
02.12.2021 17:25:44,503 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:44,503 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,503 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=660) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 77
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:44,505 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,505 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,505 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=659) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:44,505 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 139
02.12.2021 17:25:44,505 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=659): org.apache.kafka.common.requests.HeartbeatResponse@73a0c633
02.12.2021 17:25:44,505 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:44,505 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 191 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:44,505 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:44,505 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:44,505 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:44,506 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=660) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:44,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 138
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 4
02.12.2021 17:25:44,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=641) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:44,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 411
02.12.2021 17:25:44,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@36c229ab
02.12.2021 17:25:44,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 411
02.12.2021 17:25:44,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 411
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:44,519 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:44,519 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:44,519 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=641) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:44,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 492
02.12.2021 17:25:44,519 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=641): org.apache.kafka.common.requests.HeartbeatResponse@105e2e16
02.12.2021 17:25:44,519 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:44,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 492
02.12.2021 17:25:44,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 491
02.12.2021 17:25:44,550 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119419ms for 120000ms of delay, sleeping for 591ms
02.12.2021 17:25:44,578 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,581 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,584 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,584 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,583 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:44,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:44,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:44,588 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:44,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,603 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,605 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:44,615 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 310
02.12.2021 17:25:44,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,633 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,635 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,635 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:44,717 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 209
02.12.2021 17:25:44,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:44,818 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 108
02.12.2021 17:25:44,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 182
02.12.2021 17:25:44,834 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58835ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:44,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 7
02.12.2021 17:25:44,926 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:44,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:44,928 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:44,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:44,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:44,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:44,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:44,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:44,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 82
02.12.2021 17:25:44,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,012 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,085 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,090 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,091 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,100 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,113 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,136 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,138 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,132 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:45,145 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119999ms for 120000ms of delay, sleeping for 11ms
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,145 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,164 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119974ms for 120000ms of delay, sleeping for 36ms
02.12.2021 17:25:45,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:45,214 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118218ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:45,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 191
02.12.2021 17:25:45,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 200
02.12.2021 17:25:45,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:45,414 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,431 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,513 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:45,592 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,594 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,594 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,602 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:45,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:45,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:45,603 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:45,603 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,614 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:45,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:45,640 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:45,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:45,648 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,657 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,657 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,658 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,658 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:45,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:45,738 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:45,815 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:45,838 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59839ms delay out of 60000ms. Remaining 161ms. Executor queue at 0
02.12.2021 17:25:45,839 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 92
02.12.2021 17:25:45,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 8 records with 8 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 9 iterations.
02.12.2021 17:25:45,849 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59777ms for 60000ms of delay, sleeping for 233ms
02.12.2021 17:25:45,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=648): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=648): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', members=[])
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,924 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=649) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', members=[])
02.12.2021 17:25:45,925 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,925 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:45,924 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received JOIN_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1204): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:45,925 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=60, protocolType=null, protocolName='stream', leader='staging-message-processor-retry3-7f1cad50-1794-4112-bb49-b2fba405b328-StreamThread-1-consumer-7edde553-5195-4ea7-8ced-95ec6caeb692', memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', members=[])
02.12.2021 17:25:45,931 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Enabling heartbeat thread
02.12.2021 17:25:45,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 178
02.12.2021 17:25:45,925 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,932 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=649) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,931 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully joined group with generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending follower SyncGroup to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null) at generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry3', generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:45,931 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:45,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:45,933 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1206) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null,assignments=[]}
02.12.2021 17:25:45,940 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_FETCH response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1205): org.apache.kafka.common.requests.OffsetFetchResponse@30011381
02.12.2021 17:25:45,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 209
02.12.2021 17:25:45,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamTask:839] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] A committed timestamp was detected: setting the partition time of partition redacted.Cloud.Message.Callback.Retry3-4 to 1638461887004 in stream task 0_4
02.12.2021 17:25:45,941 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:868] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Initializing processor nodes of the topology
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.s.process
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-rate, group=stream-task-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-total, group=stream-task-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4}]
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Source.s.process
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-rate, group=stream-processor-node-metrics, description=The average number of calls to process per second, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Source}]
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=process-total, group=stream-processor-node-metrics, description=The total number of calls to process, tags={thread-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1, task-id=0_4, processor-node-id=Source}]
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Source.s.punctuate
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Source.s.create
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Source.s.destroy
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.ThrottleableProcessor.s.process
02.12.2021 17:25:45,947 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.ThrottleableProcessor.s.punctuate
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.ThrottleableProcessor.s.create
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.ThrottleableProcessor.s.destroy
02.12.2021 17:25:45,948 INFO [com.sigfox.kafka.throttleable.ThrottleableStreamProcessor:36] Stream 'staging-message-processor-retry3' task '0_4': pausable processor starting
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Processor.s.process
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Processor.s.punctuate
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Processor.s.create
02.12.2021 17:25:45,948 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name internal.staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1.task.0_4.node.Processor.s.destroy
02.12.2021 17:25:45,948 INFO [org.apache.kafka.streams.processor.internals.StreamTask:239] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Restored and ready to run
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:45,948 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:45,948 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from REBALANCING to RUNNING
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:45,948 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 214020ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:45,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:45,949 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:45,949 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,021 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,022 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,031 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,089 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 2 records with 9 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:46,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,090 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149039, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:46,090 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149049, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:46,090 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:46,094 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,102 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:46,102 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,099 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,108 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,103 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,116 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 10 iterations.
02.12.2021 17:25:46,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,125 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,125 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,130 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59880ms for 60000ms of delay, sleeping for 130ms
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,150 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,150 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,136 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:46,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 396
02.12.2021 17:25:46,161 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,175 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,175 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,214 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119218ms delay out of 120000ms. Remaining 782ms. Executor queue at 0
02.12.2021 17:25:46,221 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117360ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:46,239 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:46,257 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:46,257 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=865) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:46,262 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59255ms for 60000ms of delay, sleeping for 755ms
02.12.2021 17:25:46,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 276
02.12.2021 17:25:46,251 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:46,357 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=865): org.apache.kafka.common.requests.HeartbeatResponse@7b3f3678
02.12.2021 17:25:46,358 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:46,363 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 168
02.12.2021 17:25:46,373 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 64
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,440 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30265ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,441 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,449 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 214522ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,451 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 68
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30173ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,541 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,609 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:46,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,610 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,610 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,611 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,611 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:46,626 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:46,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:46,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,652 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,652 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:46,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:46,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,676 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,678 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:46,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:46,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:46,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 196
02.12.2021 17:25:46,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:46,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:46,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:46,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,941 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:46,941 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:46,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:46,942 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:46,942 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:46,952 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:46,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 215024ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:46,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:46,953 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:46,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,026 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59986ms for 60000ms of delay, sleeping for 24ms
02.12.2021 17:25:47,034 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:47,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,036 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 483
02.12.2021 17:25:47,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:47,055 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59101ms for 60000ms of delay, sleeping for 909ms
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,112 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,129 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,131 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,137 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 382
02.12.2021 17:25:47,143 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:47,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,153 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,221 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118360ms delay out of 120000ms. Remaining 1640ms. Executor queue at 0
02.12.2021 17:25:47,222 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117705ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:47,237 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 282
02.12.2021 17:25:47,244 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:47,338 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:47,344 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:47,438 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:47,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 215526ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:47,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1206): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 4, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=649): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,473 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b', protocol='stream'}
02.12.2021 17:25:47,473 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 191 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received SYNC_GROUP response from node 2147483643 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=649): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,474 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=943) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=191,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null}
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b
02.12.2021 17:25:47,473 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 51, 0, 0, 0, 1, 0, 0, 0, 4, 0, 0, 0, 48, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 4, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,474 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16', protocol='stream'}
02.12.2021 17:25:47,474 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,474 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,474 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:47,474 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,474 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16
02.12.2021 17:25:47,475 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,474 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Successfully synced group in generation Generation{generationId=60, memberId='staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba', protocol='stream'}
02.12.2021 17:25:47,475 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Executing onJoinComplete with generation 60 and memberId staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba
02.12.2021 17:25:47,475 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,475 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:47,475 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,476 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,476 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,476 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from RUNNING to REBALANCING
02.12.2021 17:25:47,476 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 157
02.12.2021 17:25:47,475 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,476 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Pausing partitions []
02.12.2021 17:25:47,476 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 190
02.12.2021 17:25:47,475 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating assignment with
02.12.2021 17:25:47,476 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Notifying assignor about the new Assignment(partitions=[redacted.Cloud.Message.Callback.Retry3-4], userDataSize=48)
02.12.2021 17:25:47,476 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:47,476 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:330] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Skip resuming since state is RUNNING
02.12.2021 17:25:47,477 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Adding newly assigned partitions: 
02.12.2021 17:25:47,477 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:47,477 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Pausing partitions [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:47,477 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:1288] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetching committed offsets for partitions: [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:47,477 TRACE [org.apache.kafka.common.requests.OffsetFetchRequest:93] Fallback the requireStable flag to false as broker only supports OffsetFetchRequest version 5. Need v7 or newer to enable this feature
02.12.2021 17:25:47,478 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending OFFSET_FETCH request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1207) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,topics=[{name=redacted.Cloud.Message.Callback.Retry3,partition_indexes=[4]}]}
02.12.2021 17:25:47,478 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received OFFSET_FETCH response from node 2147483643 for request with header RequestHeader(apiKey=OFFSET_FETCH, apiVersion=5, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1207): org.apache.kafka.common.requests.OffsetFetchResponse@365e7e76
02.12.2021 17:25:47,478 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:820] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Setting offset for partition redacted.Cloud.Message.Callback.Retry3-4 to the committed offset FetchPosition{offset=950662, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}}
02.12.2021 17:25:47,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 100
02.12.2021 17:25:47,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 476
02.12.2021 17:25:47,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,515 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=642) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:47,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 429
02.12.2021 17:25:47,515 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=642): org.apache.kafka.common.requests.HeartbeatResponse@4498b65
02.12.2021 17:25:47,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:47,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 428
02.12.2021 17:25:47,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:47,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:47,520 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=642) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:47,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 16
02.12.2021 17:25:47,520 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=642): org.apache.kafka.common.requests.HeartbeatResponse@6e672153
02.12.2021 17:25:47,521 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:47,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:47,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 15
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,536 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,536 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,574 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=943): org.apache.kafka.common.requests.HeartbeatResponse@4c421986
02.12.2021 17:25:47,575 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:47,577 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 87
02.12.2021 17:25:47,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 55
02.12.2021 17:25:47,579 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 375
02.12.2021 17:25:47,616 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 327
02.12.2021 17:25:47,616 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,617 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,617 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,637 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,641 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:47,641 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:47,641 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 519 ms and fetched 0 records
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Resuming partitions []
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,673 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,673 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,674 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,674 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,683 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,683 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:47,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 267
02.12.2021 17:25:47,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 227
02.12.2021 17:25:47,737 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:47,742 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:47,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:47,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 167
02.12.2021 17:25:47,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 126
02.12.2021 17:25:47,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:47,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:47,882 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:47,892 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 62
02.12.2021 17:25:47,917 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 26
02.12.2021 17:25:47,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:47,943 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:47,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:47,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:47,954 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:47,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:47,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Transiting to restore active tasks: {}
02.12.2021 17:25:47,955 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:47,958 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Paused partitions [] from the restore consumer
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Resuming partitions [redacted.Cloud.Message.Callback.Retry3-4]
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Transiting to update standby tasks: {}
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Resumed partitions [] from the restore consumer
02.12.2021 17:25:47,959 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:47,959 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42] State transition from REBALANCING to RUNNING
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Initialization call done. State is RUNNING
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Committing all active tasks [0_4] and standby tasks [] since 216031ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:1199] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Added READ_UNCOMMITTED fetch request for partition redacted.Cloud.Message.Callback.Retry3-4 at position FetchPosition{offset=950662, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}} to node kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.clients.FetchSessionHandler:259] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Built incremental fetch (sessionId=1759357106, epoch=505) for node 2. Added (), altered (redacted.Cloud.Message.Callback.Retry3-4), removed () out of (OSS.STAGING.Cloud.Message.Callback.Retry3-4)
02.12.2021 17:25:47,959 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:266] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(redacted.Cloud.Message.Callback.Retry3-4), toForget=(), implied=()) to broker kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)
02.12.2021 17:25:47,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:47,960 DEBUG [org.apache.kafka.clients.NetworkClient:1003] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Initiating connection to node kafka-3.data.sta.redacted:9093 (id: 2 rack: null) using address kafka-3.data.sta.par.eu.dc.sigfox.com/10.183.8.137
02.12.2021 17:25:47,961 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to SEND_APIVERSIONS_REQUEST
02.12.2021 17:25:47,961 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:215] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Creating SaslClient: client=null;service=kafka;serviceHostname=kafka-3.data.sta.redacted;mechs=[PLAIN]
02.12.2021 17:25:47,962 DEBUG [org.apache.kafka.common.network.Selector:531] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2
02.12.2021 17:25:47,966 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 0
02.12.2021 17:25:47,972 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:47,972 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,972 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 464
02.12.2021 17:25:47,973 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:47,973 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status BUFFER_UNDERFLOW
02.12.2021 17:25:47,973 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = BUFFER_UNDERFLOW HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:47,974 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59928ms for 60000ms of delay, sleeping for 82ms
02.12.2021 17:25:47,973 DEBUG [org.apache.kafka.clients.NetworkClient:955] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Completed connection to node 2. Fetching API versions.
02.12.2021 17:25:47,980 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:47,980 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 479
02.12.2021 17:25:47,980 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 2230, netWriteBuffer pos 464
02.12.2021 17:25:47,981 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:47,989 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_WRAP status OK
02.12.2021 17:25:47,990 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_TASK
02.12.2021 17:25:47,983 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 191
02.12.2021 17:25:47,990 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:47,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 469
02.12.2021 17:25:47,992 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 464
02.12.2021 17:25:47,994 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:47,995 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_WRAP
02.12.2021 17:25:47,998 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 75
02.12.2021 17:25:48,001 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:48,001 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_WRAP
02.12.2021 17:25:48,002 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,002 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 458
02.12.2021 17:25:48,003 TRACE [org.apache.kafka.common.network.SslTransportLayer:339] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 6
02.12.2021 17:25:48,009 TRACE [org.apache.kafka.common.network.SslTransportLayer:472] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeWrap 2
02.12.2021 17:25:48,009 TRACE [org.apache.kafka.common.network.SslTransportLayer:356] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_WRAP channelId 2, handshakeResult Status = OK HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 45
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status BUFFER_UNDERFLOW
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = BUFFER_UNDERFLOW HandshakeStatus = NEED_UNWRAP
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 449
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:365] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, appReadBuffer pos 0, netReadBuffer pos 51, netWriteBuffer pos 45
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:499] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap 2
02.12.2021 17:25:48,010 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus NEED_UNWRAP status OK
02.12.2021 17:25:48,011 TRACE [org.apache.kafka.common.network.SslTransportLayer:519] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake handshakeUnwrap: handshakeStatus FINISHED status OK
02.12.2021 17:25:48,011 TRACE [org.apache.kafka.common.network.SslTransportLayer:387] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake NEED_UNWRAP channelId 2, handshakeResult Status = OK HandshakeStatus = FINISHED
02.12.2021 17:25:48,011 DEBUG [org.apache.kafka.common.network.SslTransportLayer:452] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSL handshake completed successfully with peerHost 'kafka-3.data.sta.par.eu.dc.sigfox.com' peerPort 9093 peerPrincipal 'CN=*.sigfox.com, O=SIGFOX S.A, L=Labege, C=FR' cipherSuite 'TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384'
02.12.2021 17:25:48,011 TRACE [org.apache.kafka.common.network.SslTransportLayer:458] [SslTransportLayer channelId=2 key=channel=java.nio.channels.SocketChannel[connection-pending remote=kafka-3.data.sta.redacted/10.183.8.137:9093], selector=sun.nio.ch.EPollSelectorImpl@2b2deeeb, interestOps=8, readyOps=0] SSLHandshake FINISHED channelId 2, appReadBuffer pos 0, netReadBuffer pos 0, netWriteBuffer pos 45 
02.12.2021 17:25:48,011 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to RECEIVE_APIVERSIONS_RESPONSE
02.12.2021 17:25:48,011 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,011 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 448
02.12.2021 17:25:48,012 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to SEND_HANDSHAKE_REQUEST
02.12.2021 17:25:48,012 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to RECEIVE_HANDSHAKE_RESPONSE
02.12.2021 17:25:48,015 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,019 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 444
02.12.2021 17:25:48,020 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to INITIAL
02.12.2021 17:25:48,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,039 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,036 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to INTERMEDIATE
02.12.2021 17:25:48,040 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 419
02.12.2021 17:25:48,039 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,042 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:409] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Set SASL client state to COMPLETE
02.12.2021 17:25:48,043 DEBUG [org.apache.kafka.common.security.authenticator.SaslClientAuthenticator:685] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Finished authentication with no session expiration and no session re-authentication
02.12.2021 17:25:48,043 DEBUG [org.apache.kafka.common.network.Selector:560] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Successfully authenticated with kafka-3.data.sta.redacted/10.183.8.137
02.12.2021 17:25:48,043 DEBUG [org.apache.kafka.clients.NetworkClient:969] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Initiating API versions fetch from node 2.
02.12.2021 17:25:48,043 TRACE [org.apache.kafka.clients.NetworkClient:493] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] No version information found when sending API_VERSIONS with correlation id 1209 to node 2. Assuming version 3.
02.12.2021 17:25:48,043 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending API_VERSIONS request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1209) and timeout 30000 to node 2: {client_software_name=apache-kafka-java,client_software_version=2.7.0,_tagged_fields={}}
02.12.2021 17:25:48,043 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 416
02.12.2021 17:25:48,047 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 412
02.12.2021 17:25:48,047 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received API_VERSIONS response from node 2 for request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1209): org.apache.kafka.common.requests.ApiVersionsResponse@37434a12
02.12.2021 17:25:48,047 DEBUG [org.apache.kafka.clients.NetworkClient:969] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Initiating API versions fetch from node 2.
02.12.2021 17:25:48,049 TRACE [org.apache.kafka.clients.NetworkClient:493] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] No version information found when sending API_VERSIONS with correlation id 1210 to node 2. Assuming version 0.
02.12.2021 17:25:48,049 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending API_VERSIONS request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=0, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1210) and timeout 30000 to node 2: {}
02.12.2021 17:25:48,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:48,044 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,049 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 410
02.12.2021 17:25:48,054 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,055 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 405
02.12.2021 17:25:48,055 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received API_VERSIONS response from node 2 for request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=0, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1210): org.apache.kafka.common.requests.ApiVersionsResponse@1136a86
02.12.2021 17:25:48,058 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending FETCH request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1208) and timeout 30000 to node 2: {replica_id=-1,max_wait_ms=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1759357106,session_epoch=505,topics=[{topic=redacted.Cloud.Message.Callback.Retry3,partitions=[{partition=4,current_leader_epoch=-1,fetch_offset=950662,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=}
02.12.2021 17:25:48,058 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 401
02.12.2021 17:25:48,058 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 401
02.12.2021 17:25:48,061 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59465ms for 60000ms of delay, sleeping for 545ms
02.12.2021 17:25:48,062 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:48,065 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,065 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:48,065 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 394
02.12.2021 17:25:48,066 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,066 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 393
02.12.2021 17:25:48,067 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 393
02.12.2021 17:25:48,067 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,067 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 392
02.12.2021 17:25:48,075 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,088 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 384
02.12.2021 17:25:48,088 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 371
02.12.2021 17:25:48,089 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 370
02.12.2021 17:25:48,089 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 370
02.12.2021 17:25:48,099 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,099 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 360
02.12.2021 17:25:48,100 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,101 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 359
02.12.2021 17:25:48,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 82
02.12.2021 17:25:48,101 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1180] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Skipping fetch for partition redacted.Cloud.Message.Callback.Retry3-4 because previous request to kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null) has not been processed
02.12.2021 17:25:48,107 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 358
02.12.2021 17:25:48,107 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received FETCH response from node 2 for request with header RequestHeader(apiKey=FETCH, apiVersion=11, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1208): org.apache.kafka.common.requests.FetchResponse@44fb091c
02.12.2021 17:25:48,108 DEBUG [org.apache.kafka.clients.FetchSessionHandler:463] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Node 2 sent an incremental fetch response with throttleTimeMs = 0 for session 1759357106 with response=(redacted.Cloud.Message.Callback.Retry3-4)
02.12.2021 17:25:48,113 DEBUG [org.apache.kafka.clients.consumer.internals.Fetcher:315] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Fetch READ_UNCOMMITTED at offset 950662 for partition redacted.Cloud.Message.Callback.Retry3-4 returned fetch data (error=NONE, highWaterMark=951948, lastStableOffset = 951948, logStartOffset = 0, preferredReadReplica = absent, abortedTransactions = null, divergingEpoch =Optional.empty, recordsSizeInBytes=576825)
02.12.2021 17:25:48,113 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1251] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Preparing to read 576825 bytes of data for partition redacted.Cloud.Message.Callback.Retry3-4 with offset FetchPosition{offset=950662, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.par.eu.dc.sigfox.com:9093 (id: 2 rack: null)], epoch=absent}}
02.12.2021 17:25:48,113 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1275] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating high watermark for partition redacted.Cloud.Message.Callback.Retry3-4 to 951948
02.12.2021 17:25:48,113 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1280] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating log start offset for partition redacted.Cloud.Message.Callback.Retry3-4 to 0
02.12.2021 17:25:48,113 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:1285] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Updating last stable offset for partition redacted.Cloud.Message.Callback.Retry3-4 to 951948
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950662, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950672, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name redacted.Cloud.Message.Callback.Retry3-4.records-lag
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lag, group=consumer-fetch-manager-metrics, description=The latest lag of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lag-max, group=consumer-fetch-manager-metrics, description=The max lag of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lag-avg, group=consumer-fetch-manager-metrics, description=The average lag of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.common.metrics.Metrics:430] Added sensor with name redacted.Cloud.Message.Callback.Retry3-4.records-lead
02.12.2021 17:25:48,114 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lead, group=consumer-fetch-manager-metrics, description=The latest lead of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:48,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,134 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,134 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,115 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lead-min, group=consumer-fetch-manager-metrics, description=The min lead of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:48,136 TRACE [org.apache.kafka.common.metrics.Metrics:587] Registered metric named MetricName [name=records-lead-avg, group=consumer-fetch-manager-metrics, description=The average lead of the partition, tags={client-id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, topic=redacted_Cloud_Message_Callback_Retry3, partition=4}]
02.12.2021 17:25:48,136 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 177 ms and fetched 10 records
02.12.2021 17:25:48,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:48,152 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 387
02.12.2021 17:25:48,154 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,154 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,154 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 72 iterations.
02.12.2021 17:25:48,152 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,157 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,186 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:48,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,204 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,258 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:48,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 285
02.12.2021 17:25:48,253 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:48,223 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118706ms delay out of 120000ms. Remaining 1294ms. Executor queue at 1
02.12.2021 17:25:48,273 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 117847ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:48,287 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:48,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 72 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:48,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,319 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950672, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,320 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950682, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 9 ms and fetched 10 records
02.12.2021 17:25:48,324 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,325 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,325 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 73 iterations.
02.12.2021 17:25:48,372 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:48,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:48,374 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 165
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 73 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,397 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950682, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,397 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950692, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,397 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 74 iterations.
02.12.2021 17:25:48,409 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 278
02.12.2021 17:25:48,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 74 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,414 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,415 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950692, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,415 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950702, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,415 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,415 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 75 iterations.
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 75 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,433 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950702, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,433 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950712, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,435 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,435 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,435 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 76 iterations.
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 76 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,452 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950712, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,452 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950722, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,452 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,453 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,453 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 77 iterations.
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,454 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,454 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 77 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,478 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950722, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,478 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950732, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,489 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,489 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,489 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 78 iterations.
02.12.2021 17:25:48,486 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 54
02.12.2021 17:25:48,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 173
02.12.2021 17:25:48,510 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 177
02.12.2021 17:25:48,543 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,544 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,544 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 78 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 79 iterations.
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 79 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,553 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950732, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,553 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950742, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:48,554 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 79 iterations.
02.12.2021 17:25:48,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:48,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 79 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 80 iterations.
02.12.2021 17:25:48,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 80 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,574 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,575 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950742, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,575 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950752, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:48,575 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,575 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,575 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 80 iterations.
02.12.2021 17:25:48,591 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 66
02.12.2021 17:25:48,624 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59664ms for 60000ms of delay, sleeping for 346ms
02.12.2021 17:25:48,620 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 72
02.12.2021 17:25:48,635 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:48,660 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:48,660 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 264
02.12.2021 17:25:48,644 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:48,704 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,706 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 524 ms and fetched 0 records
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,711 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,716 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 209
02.12.2021 17:25:48,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:48,715 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 80 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 81 iterations.
02.12.2021 17:25:48,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 81 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,718 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,723 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950752, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,724 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950762, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,724 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 6 ms and fetched 10 records
02.12.2021 17:25:48,725 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,725 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 81 iterations.
02.12.2021 17:25:48,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 81 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 82 iterations.
02.12.2021 17:25:48,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 82 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,755 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,756 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:48,755 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950762, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,756 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950772, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:48,758 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,758 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,758 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,759 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 82 iterations.
02.12.2021 17:25:48,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 164
02.12.2021 17:25:48,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 279
02.12.2021 17:25:48,816 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 109
02.12.2021 17:25:48,856 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:48,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 82 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 83 iterations.
02.12.2021 17:25:48,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 83 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,861 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 63
02.12.2021 17:25:48,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:48,866 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950772, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,872 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950782, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,873 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 12 ms and fetched 10 records
02.12.2021 17:25:48,877 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,878 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,878 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 83 iterations.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 83 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 84 iterations.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 84 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,913 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,913 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950782, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,913 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950792, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:48,914 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:48,922 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,922 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 84 iterations.
02.12.2021 17:25:48,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 1
02.12.2021 17:25:48,929 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,932 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,932 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=650) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:48,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:48,933 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@2afb54f1
02.12.2021 17:25:48,933 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 227
02.12.2021 17:25:48,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 227
02.12.2021 17:25:48,933 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:48,938 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:48,938 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=650) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:48,939 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:48,940 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=650): org.apache.kafka.common.requests.HeartbeatResponse@24924f9b
02.12.2021 17:25:48,940 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:48,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 276
02.12.2021 17:25:48,940 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 276
02.12.2021 17:25:48,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:48,955 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,955 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:48,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:48,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:48,956 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:48,956 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:48,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:48,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 10 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:48,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:48,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:48,978 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:48,978 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149049, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:48,978 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149059, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:48,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:48,979 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:48,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:48,979 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:48,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:48,979 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 11 iterations.
02.12.2021 17:25:48,979 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59102ms for 60000ms of delay, sleeping for 908ms
02.12.2021 17:25:49,010 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:49,010 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:49,010 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1211) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:49,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 84 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 85 iterations.
02.12.2021 17:25:49,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 85 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,013 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,013 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950792, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,013 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950802, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,015 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1211): org.apache.kafka.common.requests.HeartbeatResponse@30ee26ff
02.12.2021 17:25:49,015 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:49,016 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,016 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,016 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 85 iterations.
02.12.2021 17:25:49,034 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 127
02.12.2021 17:25:49,045 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,054 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,054 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,042 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 175
02.12.2021 17:25:49,056 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,111 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:49,134 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 26
02.12.2021 17:25:49,148 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 60
02.12.2021 17:25:49,157 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:49,151 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,162 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 85 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 86 iterations.
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 86 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,164 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950802, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,164 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950812, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,164 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,165 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 86 iterations.
02.12.2021 17:25:49,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 514 ms and fetched 0 records
02.12.2021 17:25:49,174 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,176 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,218 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,217 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,230 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,230 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 86 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 87 iterations.
02.12.2021 17:25:49,257 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 87 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:49,258 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,260 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950812, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,260 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950822, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:49,260 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,260 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,260 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 87 iterations.
02.12.2021 17:25:49,261 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:49,263 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:49,274 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:49,274 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 118848ms delay out of 120000ms. Remaining 1152ms. Executor queue at 1
02.12.2021 17:25:49,274 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=866) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:49,276 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118238ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:49,279 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 87 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 88 iterations.
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 88 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,309 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950822, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,309 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950832, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,310 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,310 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,310 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 88 iterations.
02.12.2021 17:25:49,318 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 88 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 89 iterations.
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 89 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,332 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950832, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,332 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950842, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,332 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,332 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 89 iterations.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 89 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 90 iterations.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 90 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,348 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950842, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,348 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950852, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,348 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,349 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,349 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 90 iterations.
02.12.2021 17:25:49,359 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:49,361 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:49,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 90 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 91 iterations.
02.12.2021 17:25:49,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 91 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,377 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=866): org.apache.kafka.common.requests.HeartbeatResponse@51e836ab
02.12.2021 17:25:49,377 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:49,373 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950852, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,378 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950862, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,378 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:49,379 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,379 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,379 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 91 iterations.
02.12.2021 17:25:49,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:49,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 91 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 92 iterations.
02.12.2021 17:25:49,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 92 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,421 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,422 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950862, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,422 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950872, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:49,422 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,422 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,422 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 92 iterations.
02.12.2021 17:25:49,419 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 92 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 93 iterations.
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 93 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,442 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950872, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,442 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950882, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,442 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,442 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,443 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 93 iterations.
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 93 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 94 iterations.
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 94 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,450 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950882, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,450 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950892, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,450 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,450 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,451 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,451 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 94 iterations.
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,457 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 94 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 95 iterations.
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 95 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,458 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950892, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,458 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950902, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,458 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,459 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,459 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,459 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 95 iterations.
02.12.2021 17:25:49,461 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:49,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 95 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 96 iterations.
02.12.2021 17:25:49,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 96 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,477 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,478 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950902, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,478 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950912, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:49,478 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,478 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 96 iterations.
02.12.2021 17:25:49,481 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:49,496 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 96 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 97 iterations.
02.12.2021 17:25:49,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 97 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,497 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,498 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950912, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,498 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950922, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:49,504 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,504 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:49,517 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,541 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 97 iterations.
02.12.2021 17:25:49,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,555 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,555 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,556 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,556 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,558 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:49,583 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:49,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 97 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 98 iterations.
02.12.2021 17:25:49,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 98 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,602 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,603 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950922, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,604 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950932, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:49,604 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,604 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,605 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,605 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 98 iterations.
02.12.2021 17:25:49,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:49,656 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:49,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:49,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 513 ms and fetched 0 records
02.12.2021 17:25:49,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,668 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,668 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,669 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,669 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,678 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,678 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:49,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:49,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:49,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 98 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 99 iterations.
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 99 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,680 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,681 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950932, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,688 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950942, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,688 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:49,690 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,690 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 99 iterations.
02.12.2021 17:25:49,719 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:49,721 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,723 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,723 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:49,731 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:49,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,741 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,744 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:49,757 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:49,768 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 189
02.12.2021 17:25:49,783 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:49,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 99 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 100 iterations.
02.12.2021 17:25:49,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 100 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,802 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950942, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,809 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950952, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 7 ms and fetched 10 records
02.12.2021 17:25:49,810 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,810 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,810 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 100 iterations.
02.12.2021 17:25:49,823 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:49,863 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:49,870 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 87
02.12.2021 17:25:49,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 283
02.12.2021 17:25:49,895 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 100 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,903 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 101 iterations.
02.12.2021 17:25:49,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 101 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,907 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:49,911 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59707ms for 60000ms of delay, sleeping for 303ms
02.12.2021 17:25:49,924 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:49,910 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:49,924 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950952, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,926 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950962, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:49,934 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 24 ms and fetched 10 records
02.12.2021 17:25:49,938 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:49,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,938 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:49,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,938 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 101 iterations.
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:49,959 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:49,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:49,965 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 91
02.12.2021 17:25:50,001 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 179
02.12.2021 17:25:50,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:50,050 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 101 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,051 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 102 iterations.
02.12.2021 17:25:50,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 102 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,052 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,058 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950962, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,058 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950972, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,059 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:50,081 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,082 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 438
02.12.2021 17:25:50,059 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,058 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 6 ms and fetched 10 records
02.12.2021 17:25:50,082 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,082 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,083 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,091 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,105 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 102 iterations.
02.12.2021 17:25:50,106 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 74
02.12.2021 17:25:50,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,170 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,170 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 277
02.12.2021 17:25:50,182 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 338
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,192 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,192 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 102 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 103 iterations.
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 103 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,197 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950972, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,197 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950982, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:50,197 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,197 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,198 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,198 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 103 iterations.
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,229 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,229 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:50,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,253 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,240 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59459ms for 60000ms of delay, sleeping for 551ms
02.12.2021 17:25:50,253 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 176
02.12.2021 17:25:50,277 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119239ms delay out of 120000ms. Remaining 761ms. Executor queue at 1
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 42 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 78996ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 43 iterations.
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 43 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 78996ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,287 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:50,287 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 83, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:50,287 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=944) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:50,288 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018481, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:50,288 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018491, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:50,288 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 43 iterations.
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=660): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=660): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,289 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,289 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=661) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 467
02.12.2021 17:25:50,288 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:50,292 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:50,288 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119101ms for 120000ms of delay, sleeping for 909ms
02.12.2021 17:25:50,284 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 236
02.12.2021 17:25:50,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:50,292 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:50,298 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:50,308 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=661) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:50,329 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:50,328 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 343
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 103 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 104 iterations.
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 104 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,369 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,369 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950982, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,380 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=950992, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,384 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:50,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 76
02.12.2021 17:25:50,381 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 12 ms and fetched 10 records
02.12.2021 17:25:50,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 125
02.12.2021 17:25:50,397 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,398 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 104 iterations.
02.12.2021 17:25:50,393 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=661): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,399 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,399 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:50,399 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:50,399 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,399 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,399 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,400 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,400 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,400 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:50,400 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,400 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 357
02.12.2021 17:25:50,392 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=661): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,398 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294
02.12.2021 17:25:50,406 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:50,417 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:50,425 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 192 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:50,431 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:50,432 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:50,437 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:50,445 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:50,452 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:50,452 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:50,452 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:50,453 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 264
02.12.2021 17:25:50,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:50,462 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,462 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,463 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 51
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 104 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 105 iterations.
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 105 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,484 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=950992, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,484 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951002, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:50,484 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,484 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 105 iterations.
02.12.2021 17:25:50,496 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 24
02.12.2021 17:25:50,500 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 256
02.12.2021 17:25:50,509 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 183
02.12.2021 17:25:50,514 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=643) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:50,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 449
02.12.2021 17:25:50,516 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@5eed0598
02.12.2021 17:25:50,518 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 445
02.12.2021 17:25:50,522 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:50,522 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:50,522 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=643) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:50,522 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:50,523 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=643): org.apache.kafka.common.requests.HeartbeatResponse@2f93d0c2
02.12.2021 17:25:50,523 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:50,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 444
02.12.2021 17:25:50,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 59
02.12.2021 17:25:50,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:50,533 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:50,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 117
02.12.2021 17:25:50,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 105 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 106 iterations.
02.12.2021 17:25:50,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 106 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,562 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,562 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951002, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,566 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951012, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,567 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:50,572 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,572 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,572 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 106 iterations.
02.12.2021 17:25:50,583 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:50,587 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,589 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,589 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,606 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,607 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,607 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,600 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 156
02.12.2021 17:25:50,609 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 83
02.12.2021 17:25:50,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 340
02.12.2021 17:25:50,634 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:50,653 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 17
02.12.2021 17:25:50,686 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 106 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,685 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 515 ms and fetched 0 records
02.12.2021 17:25:50,691 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,691 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:50,691 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,693 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 107 iterations.
02.12.2021 17:25:50,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 107 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,693 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,693 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,694 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:50,702 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,703 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,703 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,694 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951012, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,703 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951022, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 10 ms and fetched 10 records
02.12.2021 17:25:50,703 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:50,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,707 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:50,705 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:50,712 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,712 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,712 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 107 iterations.
02.12.2021 17:25:50,711 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 45
02.12.2021 17:25:50,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,724 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 239
02.12.2021 17:25:50,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,730 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,731 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:50,762 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:50,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 107 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 108 iterations.
02.12.2021 17:25:50,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 108 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,771 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,769 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:50,772 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:50,772 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,772 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:50,773 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951022, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,776 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951032, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 10 records
02.12.2021 17:25:50,793 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,793 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,793 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 108 iterations.
02.12.2021 17:25:50,808 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 300
02.12.2021 17:25:50,807 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 396
02.12.2021 17:25:50,817 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 393
02.12.2021 17:25:50,814 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59749ms for 60000ms of delay, sleeping for 261ms
02.12.2021 17:25:50,824 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 139
02.12.2021 17:25:50,835 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 395
02.12.2021 17:25:50,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:50,908 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 108 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 109 iterations.
02.12.2021 17:25:50,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 109 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,911 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,911 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951032, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,911 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951042, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:50,910 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:50,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:50,912 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:50,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,912 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:50,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,912 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 109 iterations.
02.12.2021 17:25:50,919 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 291
02.12.2021 17:25:50,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:50,925 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 38
02.12.2021 17:25:50,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 293
02.12.2021 17:25:50,958 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 109 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 110 iterations.
02.12.2021 17:25:50,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 110 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:50,968 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:50,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:50,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:50,976 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:50,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 278
02.12.2021 17:25:50,994 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951042, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,012 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:51,024 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 186
02.12.2021 17:25:51,013 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951052, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,026 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 176
02.12.2021 17:25:51,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 49 ms and fetched 10 records
02.12.2021 17:25:51,036 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,036 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,037 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 193
02.12.2021 17:25:51,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 110 iterations.
02.12.2021 17:25:51,092 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59065ms for 60000ms of delay, sleeping for 945ms
02.12.2021 17:25:51,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,110 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:51,112 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 160
02.12.2021 17:25:51,111 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,118 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,118 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,124 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 86
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 110 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 111 iterations.
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 111 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,133 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951052, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,133 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951062, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,133 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,133 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 111 iterations.
02.12.2021 17:25:51,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 67
02.12.2021 17:25:51,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:51,193 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:51,202 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,209 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119907ms for 120000ms of delay, sleeping for 103ms
02.12.2021 17:25:51,210 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:51,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,219 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,220 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,212 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 60
02.12.2021 17:25:51,219 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,242 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 512 ms and fetched 0 records
02.12.2021 17:25:51,247 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,250 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,250 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,250 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 111 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 112 iterations.
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 112 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,254 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951062, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,254 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951072, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,255 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,255 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,255 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 112 iterations.
02.12.2021 17:25:51,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 508 ms and fetched 0 records
02.12.2021 17:25:51,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,282 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,294 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 194
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 112 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 113 iterations.
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 113 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,309 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951072, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,309 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951082, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,309 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:51,309 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,309 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 113 iterations.
02.12.2021 17:25:51,315 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119878ms for 120000ms of delay, sleeping for 132ms
02.12.2021 17:25:51,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 296
02.12.2021 17:25:51,351 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:51,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 113 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 114 iterations.
02.12.2021 17:25:51,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 114 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,359 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,360 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951082, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,360 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951092, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:51,360 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,360 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,360 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 114 iterations.
02.12.2021 17:25:51,371 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 114 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 115 iterations.
02.12.2021 17:25:51,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 115 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,372 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951092, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,372 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951102, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,372 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,373 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,373 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,373 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 115 iterations.
02.12.2021 17:25:51,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,395 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 94
02.12.2021 17:25:51,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 115 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 116 iterations.
02.12.2021 17:25:51,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 116 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,396 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,396 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951102, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,397 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951112, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:51,397 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,397 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,397 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 116 iterations.
02.12.2021 17:25:51,410 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:51,432 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:51,430 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 290
02.12.2021 17:25:51,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:51,455 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119869ms for 120000ms of delay, sleeping for 141ms
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 116 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 117 iterations.
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 117 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,467 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951112, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,467 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951122, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,467 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,468 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,468 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,468 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 117 iterations.
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 117 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 118 iterations.
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 118 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,490 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 293
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,490 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,491 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951122, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,491 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951132, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:51,491 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 118 iterations.
02.12.2021 17:25:51,491 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,492 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,492 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 118 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 119 iterations.
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 119 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,507 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951132, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,507 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951142, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,508 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,508 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,508 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 119 iterations.
02.12.2021 17:25:51,511 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:51,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 119 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 120 iterations.
02.12.2021 17:25:51,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 120 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,521 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,522 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951142, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,522 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951152, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:51,522 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,522 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,522 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 120 iterations.
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 120 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 121 iterations.
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 121 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,531 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951152, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,531 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951162, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,531 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,531 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 121 iterations.
02.12.2021 17:25:51,546 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 174
02.12.2021 17:25:51,545 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 73
02.12.2021 17:25:51,553 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:51,593 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:51,590 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:51,613 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:51,623 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119534ms for 120000ms of delay, sleeping for 476ms
02.12.2021 17:25:51,620 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,625 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 121 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,646 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 74
02.12.2021 17:25:51,627 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 122 iterations.
02.12.2021 17:25:51,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 122 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,650 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,651 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951162, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,651 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951172, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:51,651 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,656 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,656 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,658 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,659 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 122 iterations.
02.12.2021 17:25:51,702 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 81
02.12.2021 17:25:51,700 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 292
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,709 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,709 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 220
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 122 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 123 iterations.
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 123 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,717 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951172, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,717 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951182, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:51,717 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,717 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 123 iterations.
02.12.2021 17:25:51,726 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:51,723 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:51,726 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,728 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:51,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:51,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:51,729 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:51,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,750 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,754 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,754 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 179
02.12.2021 17:25:51,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 123 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 124 iterations.
02.12.2021 17:25:51,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 124 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,756 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,757 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951182, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,757 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951192, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:51,757 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,757 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,757 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 124 iterations.
02.12.2021 17:25:51,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:51,796 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,801 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:51,805 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:51,810 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 119
02.12.2021 17:25:51,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:51,827 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:51,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 124 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 125 iterations.
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 125 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 78
02.12.2021 17:25:51,853 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,856 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951192, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,857 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951202, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 5 ms and fetched 10 records
02.12.2021 17:25:51,859 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:51,859 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,859 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:51,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,869 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 125 iterations.
02.12.2021 17:25:51,911 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:51,903 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 398
02.12.2021 17:25:51,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 13
02.12.2021 17:25:51,933 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,930 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,934 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,934 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=651) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:51,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:51,934 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=651): org.apache.kafka.common.requests.HeartbeatResponse@1e01ab21
02.12.2021 17:25:51,934 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 275
02.12.2021 17:25:51,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 275
02.12.2021 17:25:51,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:51,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 187
02.12.2021 17:25:51,933 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:51,943 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:51,943 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=651) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:51,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 321
02.12.2021 17:25:51,945 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=651): org.apache.kafka.common.requests.HeartbeatResponse@37f5c592
02.12.2021 17:25:51,945 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:51,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 309
02.12.2021 17:25:51,945 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 309
02.12.2021 17:25:51,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 125 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 126 iterations.
02.12.2021 17:25:51,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 126 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:51,982 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:51,986 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951202, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,990 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951212, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:51,990 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 8 ms and fetched 10 records
02.12.2021 17:25:51,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:51,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:51,992 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:51,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:51,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:51,992 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:51,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:51,993 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:51,993 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,003 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,003 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,003 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,009 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,014 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 126 iterations.
02.12.2021 17:25:52,013 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 288
02.12.2021 17:25:52,024 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:52,025 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:52,025 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1212) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:52,035 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 174
02.12.2021 17:25:52,040 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59966ms for 60000ms of delay, sleeping for 44ms
02.12.2021 17:25:52,041 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 84
02.12.2021 17:25:52,036 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 193
02.12.2021 17:25:52,045 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 209
02.12.2021 17:25:52,090 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59984ms for 60000ms of delay, sleeping for 26ms
02.12.2021 17:25:52,093 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:52,117 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 11 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,119 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119887ms for 120000ms of delay, sleeping for 123ms
02.12.2021 17:25:52,118 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:52,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,125 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 176
02.12.2021 17:25:52,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,133 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1212): org.apache.kafka.common.requests.HeartbeatResponse@3ccc3848
02.12.2021 17:25:52,133 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:52,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 74
02.12.2021 17:25:52,126 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,135 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,135 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,135 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,120 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,138 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149059, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:52,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 106
02.12.2021 17:25:52,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 126 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 127 iterations.
02.12.2021 17:25:52,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 127 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 84
02.12.2021 17:25:52,142 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149069, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:52,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 43 ms and fetched 10 records
02.12.2021 17:25:52,163 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:52,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 12 iterations.
02.12.2021 17:25:52,165 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59194ms for 60000ms of delay, sleeping for 816ms
02.12.2021 17:25:52,158 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,173 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951212, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,185 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951222, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,187 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 29 ms and fetched 10 records
02.12.2021 17:25:52,193 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,193 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,196 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,196 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 127 iterations.
02.12.2021 17:25:52,209 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,207 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 287
02.12.2021 17:25:52,219 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,222 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,223 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,223 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:52,225 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 76
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 516 ms and fetched 0 records
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,245 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,246 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,246 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,257 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119096ms for 120000ms of delay, sleeping for 914ms
02.12.2021 17:25:52,256 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,286 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:52,293 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:52,293 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=867) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:52,312 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:52,311 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 127 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 128 iterations.
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 128 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,316 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951222, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,316 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951232, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,316 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,314 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,317 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,317 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,317 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,319 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,319 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,319 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 128 iterations.
02.12.2021 17:25:52,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 172
02.12.2021 17:25:52,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,346 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,364 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,393 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=867): org.apache.kafka.common.requests.HeartbeatResponse@413efe43
02.12.2021 17:25:52,397 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:52,417 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 128 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 129 iterations.
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 129 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,419 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,425 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951232, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:52,426 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951242, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,428 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 9 ms and fetched 10 records
02.12.2021 17:25:52,428 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 65
02.12.2021 17:25:52,433 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,433 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,433 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,434 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 129 iterations.
02.12.2021 17:25:52,437 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:52,452 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 294
02.12.2021 17:25:52,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 129 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 130 iterations.
02.12.2021 17:25:52,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 130 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,463 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,464 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951242, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,464 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951252, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,464 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,464 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,464 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 130 iterations.
02.12.2021 17:25:52,474 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 290
02.12.2021 17:25:52,482 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 130 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 131 iterations.
02.12.2021 17:25:52,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 131 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,483 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951252, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,483 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951262, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,483 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,486 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,487 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,488 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,488 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 131 iterations.
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,498 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,498 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 131 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,505 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 132 iterations.
02.12.2021 17:25:52,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 132 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,506 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,507 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951262, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,507 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951272, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,507 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:52,511 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,511 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 132 iterations.
02.12.2021 17:25:52,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 299
02.12.2021 17:25:52,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:52,537 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:52,555 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 191
02.12.2021 17:25:52,575 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 189
02.12.2021 17:25:52,599 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:52,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:52,618 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 199
02.12.2021 17:25:52,644 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 132 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,642 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,647 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,647 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:52,655 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 91
02.12.2021 17:25:52,646 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 133 iterations.
02.12.2021 17:25:52,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 133 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,672 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,680 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,681 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951272, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,681 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951282, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,681 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:52,687 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 77
02.12.2021 17:25:52,687 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,690 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,690 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 133 iterations.
02.12.2021 17:25:52,699 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:52,735 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 82
02.12.2021 17:25:52,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Committing all active tasks [] and standby tasks [] since 30281ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,736 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,747 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:52,752 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:52,752 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:52,755 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 392
02.12.2021 17:25:52,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 133 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 134 iterations.
02.12.2021 17:25:52,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 134 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,766 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,767 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951282, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,767 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951292, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,765 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:52,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,767 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Committing all active tasks [] and standby tasks [] since 30304ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:52,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:52,767 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:52,772 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,772 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,772 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 134 iterations.
02.12.2021 17:25:52,801 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:52,817 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:52,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:52,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 469
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 134 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 135 iterations.
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 135 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,821 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951292, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,821 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951302, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:52,822 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 135 iterations.
02.12.2021 17:25:52,837 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:52,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 135 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,845 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 136 iterations.
02.12.2021 17:25:52,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 136 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,846 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951302, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,846 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951312, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,846 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,847 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,847 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,847 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 136 iterations.
02.12.2021 17:25:52,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:52,861 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 286
02.12.2021 17:25:52,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:52,901 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:52,920 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 369
02.12.2021 17:25:52,918 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 136 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 137 iterations.
02.12.2021 17:25:52,925 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 137 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,927 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,930 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,934 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951312, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,939 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951322, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,940 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 10 ms and fetched 10 records
02.12.2021 17:25:52,944 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,944 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,944 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 137 iterations.
02.12.2021 17:25:52,957 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 295
02.12.2021 17:25:52,961 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 186
02.12.2021 17:25:52,971 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:52,984 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59980ms for 60000ms of delay, sleeping for 30ms
02.12.2021 17:25:52,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 137 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,986 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 138 iterations.
02.12.2021 17:25:52,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 138 iterations; invoking punctuators if necessary
02.12.2021 17:25:52,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:52,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:52,987 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951322, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,987 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951332, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:52,987 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:52,988 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:52,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:52,988 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:52,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:52,988 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 138 iterations.
02.12.2021 17:25:53,016 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59134ms for 60000ms of delay, sleeping for 876ms
02.12.2021 17:25:53,012 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 514 ms and fetched 0 records
02.12.2021 17:25:53,025 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,025 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,020 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 269
02.12.2021 17:25:53,026 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,029 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 485
02.12.2021 17:25:53,032 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239926ms for 240000ms of delay, sleeping for 84ms
02.12.2021 17:25:53,037 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,058 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 194
02.12.2021 17:25:53,062 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 86
02.12.2021 17:25:53,072 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:53,130 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 384
02.12.2021 17:25:53,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 162
02.12.2021 17:25:53,138 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:53,137 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239975ms for 240000ms of delay, sleeping for 35ms
02.12.2021 17:25:53,153 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 506 ms and fetched 0 records
02.12.2021 17:25:53,162 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,163 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,163 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,163 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 359
02.12.2021 17:25:53,158 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 94
02.12.2021 17:25:53,174 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:53,186 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119253ms for 120000ms of delay, sleeping for 757ms
02.12.2021 17:25:53,196 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239258ms for 240000ms of delay, sleeping for 752ms
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 51
02.12.2021 17:25:53,237 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,239 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,238 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 276
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,259 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,259 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 33
02.12.2021 17:25:53,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 258
02.12.2021 17:25:53,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:53,274 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,274 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,275 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,289 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,290 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,292 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,292 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 0
02.12.2021 17:25:53,292 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,292 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,292 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=662) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null}
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=662) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null}
02.12.2021 17:25:53,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 27
02.12.2021 17:25:53,293 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 467
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=662): org.apache.kafka.common.requests.HeartbeatResponse@6f8963ce
02.12.2021 17:25:53,293 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=662): org.apache.kafka.common.requests.HeartbeatResponse@773a8ae9
02.12.2021 17:25:53,293 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,293 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1110] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Attempt to heartbeat failed since group is rebalancing
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:53,294 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:674] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinPrepare with generation 192 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,294 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:53,294 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,295 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=663) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,295 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 0])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:53,295 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 464
02.12.2021 17:25:53,295 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=663) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=90 cap=90]}]}
02.12.2021 17:25:53,296 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 24
02.12.2021 17:25:53,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,321 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,339 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,342 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 172
02.12.2021 17:25:53,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:53,375 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,393 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,393 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:53,439 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:53,443 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 71
02.12.2021 17:25:53,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 57
02.12.2021 17:25:53,475 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,514 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,517 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,518 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,518 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,518 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=644) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:53,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 11
02.12.2021 17:25:53,520 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@5d19767a
02.12.2021 17:25:53,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 9
02.12.2021 17:25:53,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 8
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,524 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:53,525 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:53,525 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:53,525 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=644) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:53,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:53,526 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=644): org.apache.kafka.common.requests.HeartbeatResponse@174124b5
02.12.2021 17:25:53,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:53,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:53,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 137
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,529 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,529 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,540 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,576 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:53,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 36
02.12.2021 17:25:53,630 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:53,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,664 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:53,676 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:53,736 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 293
02.12.2021 17:25:53,739 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,741 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,742 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,742 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,743 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,743 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,760 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,761 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,761 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:53,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:53,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:53,764 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:53,764 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:53,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:53,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:53,822 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:53,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:53,836 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 193
02.12.2021 17:25:53,844 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:53,865 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:53,878 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:53,894 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59952ms for 60000ms of delay, sleeping for 58ms
02.12.2021 17:25:53,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 93
02.12.2021 17:25:53,950 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119077ms for 120000ms of delay, sleeping for 933ms
02.12.2021 17:25:53,944 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:53,953 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 59804ms for 60000ms of delay, sleeping for 206ms
02.12.2021 17:25:53,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 138 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 139 iterations.
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 139 iterations; invoking punctuators if necessary
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:53,969 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951332, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:53,969 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951342, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:53,969 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:53,970 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:53,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:53,970 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:53,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:53,970 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 139 iterations.
02.12.2021 17:25:53,970 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239763ms for 240000ms of delay, sleeping for 247ms
02.12.2021 17:25:53,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,030 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,031 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,031 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,051 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:54,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:54,087 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 192
02.12.2021 17:25:54,131 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,165 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,155 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 88
02.12.2021 17:25:54,171 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58388ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:54,187 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 91
02.12.2021 17:25:54,236 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 295
02.12.2021 17:25:54,232 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239293ms for 240000ms of delay, sleeping for 717ms
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 511 ms and fetched 0 records
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,254 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,262 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,266 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:54,265 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,272 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,280 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,283 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:54,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,331 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,331 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:54,362 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,367 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:54,436 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:54,462 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:54,467 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:54,484 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,532 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,532 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,562 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 200
02.12.2021 17:25:54,567 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:54,632 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:54,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:54,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,666 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,666 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,667 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,667 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:54,685 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:54,733 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 509 ms and fetched 0 records
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,763 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,763 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 167
02.12.2021 17:25:54,767 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:54,774 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:54,775 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:54,775 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 149
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:54,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:54,833 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:54,834 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:54,864 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 66
02.12.2021 17:25:54,868 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:54,885 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119632ms for 120000ms of delay, sleeping for 378ms
02.12.2021 17:25:54,886 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 47
02.12.2021 17:25:54,930 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,930 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,931 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=652) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:54,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,932 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=652): org.apache.kafka.common.requests.HeartbeatResponse@36f2d87a
02.12.2021 17:25:54,932 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 331
02.12.2021 17:25:54,932 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 331
02.12.2021 17:25:54,934 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:54,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:54,936 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:54,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:54,936 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=652) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:54,937 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 348
02.12.2021 17:25:54,937 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=652): org.apache.kafka.common.requests.HeartbeatResponse@35fdfcdd
02.12.2021 17:25:54,937 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:54,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 347
02.12.2021 17:25:54,938 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 346
02.12.2021 17:25:54,963 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239763ms for 240000ms of delay, sleeping for 247ms
02.12.2021 17:25:54,968 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,033 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 231
02.12.2021 17:25:55,035 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,037 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,038 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,041 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:55,043 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:55,040 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 244
02.12.2021 17:25:55,043 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1213) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:55,068 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 99
02.12.2021 17:25:55,133 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 130
02.12.2021 17:25:55,140 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,145 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 139
02.12.2021 17:25:55,147 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1213): org.apache.kafka.common.requests.HeartbeatResponse@1e30f204
02.12.2021 17:25:55,147 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:55,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,167 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,168 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,176 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,176 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,171 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59388ms delay out of 60000ms. Remaining 612ms. Executor queue at 0
02.12.2021 17:25:55,189 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58950ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:55,216 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239112ms for 240000ms of delay, sleeping for 898ms
02.12.2021 17:25:55,234 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 30
02.12.2021 17:25:55,240 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:55,245 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 39
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,264 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,264 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 43 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 83975ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 44 iterations.
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 44 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 83975ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:55,266 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=944): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:55,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=192, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', members=[])
02.12.2021 17:25:55,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:55,267 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:55,267 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:55,268 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018491, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:55,268 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=945) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,assignments=[]}
02.12.2021 17:25:55,268 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018501, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:55,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 2 ms and fetched 10 records
02.12.2021 17:25:55,268 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:55,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,268 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:55,268 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 44 iterations.
02.12.2021 17:25:55,269 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119493ms for 120000ms of delay, sleeping for 517ms
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,276 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,276 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,277 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,285 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,305 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:55,306 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:55,306 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=868) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:55,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,335 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,335 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,336 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,336 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,340 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:55,365 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,368 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=945): SyncGroupResponseData(throttleTimeMs=0, errorCode=27, protocolType=null, protocolName=null, assignment=[])
02.12.2021 17:25:55,368 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:781] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] SyncGroup failed: The group began another rebalance. Need to re-join the group. Sent generation was Generation{generationId=192, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', protocol='stream'}
02.12.2021 17:25:55,377 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,385 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,406 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=868): org.apache.kafka.common.requests.HeartbeatResponse@45f28fc
02.12.2021 17:25:55,406 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:55,441 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:55,465 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,478 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:55,485 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,539 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,539 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,566 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,578 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 98
02.12.2021 17:25:55,585 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:55,640 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,666 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:55,676 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,677 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,677 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:55,690 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 94
02.12.2021 17:25:55,741 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:55,769 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,770 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,770 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:55,777 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:55,777 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,778 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:55,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:55,785 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,787 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119626ms for 120000ms of delay, sleeping for 384ms
02.12.2021 17:25:55,785 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,791 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,791 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:55,841 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:55,842 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:55,842 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:55,843 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:55,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:55,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:55,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:55,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:55,844 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:55,845 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:55,871 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:55,879 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:55,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:55,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:55,976 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 295
02.12.2021 17:25:55,979 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:55,992 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,041 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,042 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,042 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,049 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,049 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 469
02.12.2021 17:25:56,080 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:56,076 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:56,092 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:56,119 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239993ms for 240000ms of delay, sleeping for 17ms
02.12.2021 17:25:56,140 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239956ms for 240000ms of delay, sleeping for 54ms
02.12.2021 17:25:56,149 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 369
02.12.2021 17:25:56,175 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119932ms for 120000ms of delay, sleeping for 78ms
02.12.2021 17:25:56,180 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:56,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,182 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,182 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,183 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,183 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 342
02.12.2021 17:25:56,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 84
02.12.2021 17:25:56,191 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59952ms delay out of 60000ms. Remaining 48ms. Executor queue at 0
02.12.2021 17:25:56,196 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:56,197 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58018ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:56,201 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239996ms for 240000ms of delay, sleeping for 14ms
02.12.2021 17:25:56,257 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 261
02.12.2021 17:25:56,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 139 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,272 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,278 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,269 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 140 iterations.
02.12.2021 17:25:56,280 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119787ms for 120000ms of delay, sleeping for 223ms
02.12.2021 17:25:56,279 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 140 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:56,278 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,284 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,284 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,283 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 242
02.12.2021 17:25:56,282 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:56,288 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951342, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:56,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,291 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,289 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951352, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:56,299 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 17 ms and fetched 10 records
02.12.2021 17:25:56,292 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,291 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,300 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,302 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:56,302 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,302 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,302 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:56,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,307 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 140 iterations.
02.12.2021 17:25:56,307 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239300ms for 240000ms of delay, sleeping for 710ms
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,347 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,348 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,357 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 161
02.12.2021 17:25:56,379 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,387 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 138
02.12.2021 17:25:56,406 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 397
02.12.2021 17:25:56,464 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 54
02.12.2021 17:25:56,479 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:56,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 38
02.12.2021 17:25:56,505 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119548ms for 120000ms of delay, sleeping for 462ms
02.12.2021 17:25:56,506 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 296
02.12.2021 17:25:56,519 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,519 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,519 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=645) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:56,519 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 30
02.12.2021 17:25:56,520 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=645): org.apache.kafka.common.requests.HeartbeatResponse@7a319303
02.12.2021 17:25:56,521 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:56,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 28
02.12.2021 17:25:56,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:56,526 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:56,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=645) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:56,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 157
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=645): org.apache.kafka.common.requests.HeartbeatResponse@768e86d5
02.12.2021 17:25:56,527 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:56,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:56,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 156
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,550 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,550 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,581 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:56,606 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 196
02.12.2021 17:25:56,628 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 55
02.12.2021 17:25:56,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:56,681 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:56,687 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,689 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,691 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:56,710 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 92
02.12.2021 17:25:56,753 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:56,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:56,778 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,779 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,779 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,779 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,792 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:56,802 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:56,801 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 510 ms and fetched 0 records
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:56,809 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,809 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,813 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,813 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,813 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:56,848 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:56,849 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:56,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:56,853 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:56,880 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,894 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:56,915 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:56,953 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:56,974 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119813ms for 120000ms of delay, sleeping for 197ms
02.12.2021 17:25:56,981 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:56,994 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:57,015 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:57,020 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239858ms for 240000ms of delay, sleeping for 152ms
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,053 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,053 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,086 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 195
02.12.2021 17:25:57,096 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:57,119 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 194
02.12.2021 17:25:57,154 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:57,173 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119958ms for 120000ms of delay, sleeping for 52ms
02.12.2021 17:25:57,176 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239888ms for 240000ms of delay, sleeping for 122ms
02.12.2021 17:25:57,186 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 505 ms and fetched 0 records
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,194 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,199 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59020ms delay out of 60000ms. Remaining 980ms. Executor queue at 0
02.12.2021 17:25:57,202 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58818ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:57,194 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,220 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 93
02.12.2021 17:25:57,229 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 119736ms for 120000ms of delay, sleeping for 274ms
02.12.2021 17:25:57,256 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 297
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,281 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,281 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,299 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239135ms for 240000ms of delay, sleeping for 875ms
02.12.2021 17:25:57,303 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 391
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 504 ms and fetched 0 records
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,313 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,313 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,320 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:57,349 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,350 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,350 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:57,381 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:57,403 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 291
02.12.2021 17:25:57,421 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:57,457 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:57,482 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:57,504 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:57,507 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118592ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:57,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:57,553 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,554 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,554 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,582 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:57,604 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:57,622 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 198
02.12.2021 17:25:57,654 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,686 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:57,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,695 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,696 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,696 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,696 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:57,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 95
02.12.2021 17:25:57,761 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 294
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,784 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,784 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 146
02.12.2021 17:25:57,796 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:57,814 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:57,818 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,818 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:57,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:57,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:57,819 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:57,820 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 499
02.12.2021 17:25:57,820 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,821 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,822 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 113
02.12.2021 17:25:57,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:57,850 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:57,851 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:57,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:57,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:57,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:57,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:57,851 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:57,851 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:57,873 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 181
02.12.2021 17:25:57,885 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 45
02.12.2021 17:25:57,897 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:57,922 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 12
02.12.2021 17:25:57,934 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,936 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,936 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=653) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer-33faa43d-6f49-4cb9-85b0-f71e8782ff0b,group_instance_id=null}
02.12.2021 17:25:57,934 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,936 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 385
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@4f71c2e8
02.12.2021 17:25:57,943 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 378
02.12.2021 17:25:57,943 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 378
02.12.2021 17:25:57,935 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:57,945 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:57,945 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=653) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer-a0758338-fe5a-4015-a623-91904ee885ba,group_instance_id=null}
02.12.2021 17:25:57,935 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 0
02.12.2021 17:25:57,947 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, correlationId=653): org.apache.kafka.common.requests.HeartbeatResponse@138b2804
02.12.2021 17:25:57,947 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:57,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 337
02.12.2021 17:25:57,947 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 337
02.12.2021 17:25:57,973 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 81
02.12.2021 17:25:57,997 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 199
02.12.2021 17:25:58,043 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 278
02.12.2021 17:25:58,047 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 237
02.12.2021 17:25:58,055 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,063 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,080 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry3] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:58,086 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending Heartbeat request with generation 60 and member id staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16 to coordinator kafka-5.data.sta.redacted:9093 (id: 2147483643 rack: null)
02.12.2021 17:25:58,086 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1214) and timeout 30000 to node 2147483643: {group_id=staging-message-processor-retry3,generation_id=60,member_id=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer-cb380aac-bfd6-4134-ab9c-84a470a80f16,group_instance_id=null}
02.12.2021 17:25:58,100 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 96
02.12.2021 17:25:58,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 136
02.12.2021 17:25:58,148 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 174
02.12.2021 17:25:58,164 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,187 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received HEARTBEAT response from node 2147483643 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, correlationId=1214): org.apache.kafka.common.requests.HeartbeatResponse@3de6084a
02.12.2021 17:25:58,188 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Received successful Heartbeat response
02.12.2021 17:25:58,203 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59819ms delay out of 60000ms. Remaining 181ms. Executor queue at 0
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 10 records with 12 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,203 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processed 0 records with 13 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:58,204 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Returning 10 fetched records at offset FetchPosition{offset=1149069, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:58,204 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Update fetching position to FetchPosition{offset=1149079, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry1-7
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Main Consumer poll completed in 0 ms and fetched 10 records
02.12.2021 17:25:58,204 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry1-7, new queue size is 10
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,204 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1] Processing tasks with 13 iterations.
02.12.2021 17:25:58,205 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58284ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 516 ms and fetched 0 records
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,212 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,213 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,235 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239821ms for 240000ms of delay, sleeping for 189ms
02.12.2021 17:25:58,255 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 67
02.12.2021 17:25:58,254 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 30
02.12.2021 17:25:58,275 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 288
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,286 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,286 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,302 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry2] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:58,303 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending Heartbeat request with generation 192 and member id staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262 to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:58,303 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=946) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=192,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null}
02.12.2021 17:25:58,320 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,321 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,321 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,322 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,322 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,323 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 390
02.12.2021 17:25:58,323 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:58,323 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:58,324 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=869) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer-a09804b1-1d79-4825-a2ef-153bae03cb48,group_instance_id=null}
02.12.2021 17:25:58,323 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,324 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,324 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,353 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,353 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,383 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 180
02.12.2021 17:25:58,386 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,404 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Received HEARTBEAT response from node 2147483645 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=946): org.apache.kafka.common.requests.HeartbeatResponse@65322568
02.12.2021 17:25:58,404 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1114] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Ignoring heartbeat response with error REBALANCE_IN_PROGRESS during COMPLETING_REBALANCE state
02.12.2021 17:25:58,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 290
02.12.2021 17:25:58,424 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, correlationId=869): org.apache.kafka.common.requests.HeartbeatResponse@65142f9
02.12.2021 17:25:58,424 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-1-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:58,424 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,425 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239256ms for 240000ms of delay, sleeping for 754ms
02.12.2021 17:25:58,483 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 80
02.12.2021 17:25:58,487 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:58,510 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119595ms delay out of 120000ms. Remaining 405ms. Executor queue at 0
02.12.2021 17:25:58,511 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118381ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:58,523 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 190
02.12.2021 17:25:58,525 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,563 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,563 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,587 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,624 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 89
02.12.2021 17:25:58,625 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:58,664 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:58,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 97
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,714 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,714 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:58,725 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:58,765 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 298
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,786 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,786 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,814 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:58,823 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:58,824 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,826 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:58,825 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:58,826 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,854 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:58,855 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:58,855 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:58,866 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:58,887 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:58,916 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:58,926 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:58,966 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:58,989 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 298
02.12.2021 17:25:59,017 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:59,027 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 299
02.12.2021 17:25:59,063 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,064 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,064 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 455
02.12.2021 17:25:59,089 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 197
02.12.2021 17:25:59,117 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 97
02.12.2021 17:25:59,127 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,165 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 354
02.12.2021 17:25:59,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 10 records with 140 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 141 iterations.
02.12.2021 17:25:59,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processed 0 records with 141 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,188 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:59,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Returning 10 fetched records at offset FetchPosition{offset=951352, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:59,188 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1-consumer, groupId=staging-message-processor-retry3] Update fetching position to FetchPosition{offset=951362, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-3.data.sta.redacted:9093 (id: 2 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry3-4
02.12.2021 17:25:59,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:59,189 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] task [0_4] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry3-4, new queue size is 10
02.12.2021 17:25:59,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,189 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:59,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,189 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-1] Processing tasks with 141 iterations.
02.12.2021 17:25:59,190 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239341ms for 240000ms of delay, sleeping for 669ms
02.12.2021 17:25:59,190 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 96
02.12.2021 17:25:59,205 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 59284ms delay out of 60000ms. Remaining 716ms. Executor queue at 0
02.12.2021 17:25:59,208 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 58332ms for 60000ms of delay, sleeping for 1000ms
02.12.2021 17:25:59,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 507 ms and fetched 0 records
02.12.2021 17:25:59,221 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,221 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,222 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,222 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 304
02.12.2021 17:25:59,227 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,271 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 248
02.12.2021 17:25:59,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,287 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,287 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,288 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,288 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,323 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 203
02.12.2021 17:25:59,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,326 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 502 ms and fetched 0 records
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,327 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,327 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,356 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,356 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,371 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 148
02.12.2021 17:25:59,388 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,423 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 103
02.12.2021 17:25:59,427 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,471 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 48
02.12.2021 17:25:59,488 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:59,511 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:51] Sleep was not enough, scheduling execution for message with 119381ms delay out of 120000ms. Remaining 619ms. Executor queue at 1
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 10 records with 44 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 88220ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 45 iterations.
02.12.2021 17:25:59,511 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processed 0 records with 45 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] 0 punctuators ran.
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:882] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Committing all active tasks [0_7] and standby tasks [] since 88221ms has elapsed (commit interval is 30000ms)
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:900] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Unable to commit as we are in the middle of a rebalance, will try again when it completes.
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Invoking poll on main Consumer
02.12.2021 17:25:59,512 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:472] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Rebalance failed.
02.12.2021 17:25:59,512 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:540] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] (Re-)joining group
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:215] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Joining group with current subscription: [redacted.Cloud.Message.Callback.Retry2]
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:552] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JoinGroup (JoinGroupRequestData(groupId='staging-message-processor-retry2', sessionTimeoutMs=20000, rebalanceTimeoutMs=300000, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262', groupInstanceId=null, protocolType='consumer', protocols=[JoinGroupRequestProtocol(name='stream', metadata=[0, 1, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 33, 0, 0, 0, 8, 0, 0, 0, 8, 102, 82, -104, 36, 66, -4, 64, -60, -115, 121, -86, 79, -18, -91, -89, 50, 0, 0, 0, 0, 0, 0, 0, 0, 84, 0, 0, 0, 1, 0, 41, 79, 83, 83, 46, 83, 84, 65, 71, 73, 78, 71, 46, 67, 108, 111, 117, 100, 46, 77, 101, 115, 115, 97, 103, 101, 46, 67, 97, 108, 108, 98, 97, 99, 107, 46, 82, 101, 116, 114, 121, 50, 0, 0, 0, 1, 0, 0, 0, 7])])) to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null)
02.12.2021 17:25:59,512 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Sending JOIN_GROUP request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, correlationId=947) and timeout 305000 to node 2147483645: {group_id=staging-message-processor-retry2,session_timeout_ms=20000,rebalance_timeout_ms=300000,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer-3ab1ad8c-7553-4615-8489-33529f5ab262,group_instance_id=null,protocol_type=consumer,protocols=[{name=stream,metadata=java.nio.HeapByteBuffer[pos=0 lim=141 cap=141]}]}
02.12.2021 17:25:59,513 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:689] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Returning 10 fetched records at offset FetchPosition{offset=1018501, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for assigned partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:59,513 TRACE [org.apache.kafka.clients.consumer.internals.Fetcher:697] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Update fetching position to FetchPosition{offset=1018511, offsetEpoch=Optional[0], currentLeader=LeaderAndEpoch{leader=Optional[kafka-4.data.sta.redacted:9093 (id: 3 rack: null)], epoch=absent}} for partition OSS.STAGING.Cloud.Message.Callback.Retry2-7
02.12.2021 17:25:59,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Main Consumer poll completed in 1 ms and fetched 10 records
02.12.2021 17:25:59,513 TRACE [org.apache.kafka.streams.processor.internals.StreamTask:891] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] task [0_7] Added records into the buffered queue of partition redacted.Cloud.Message.Callback.Retry2-7, new queue size is 10
02.12.2021 17:25:59,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,513 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Finished restoring all changelogs []
02.12.2021 17:25:59,513 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1] Processing tasks with 45 iterations.
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=663): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received JOIN_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=JOIN_GROUP, apiVersion=5, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=663): JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', members=[])
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,514 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=664) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,514 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:576] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful JoinGroup response: JoinGroupResponseData(throttleTimeMs=0, errorCode=0, generationId=193, protocolType=null, protocolName='stream', leader='staging-message-processor-retry2-f055f10f-2377-42c8-a04b-a6080c326d2b-StreamThread-2-consumer-2af19565-f553-4935-a843-ff3b226b375c', memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', members=[])
02.12.2021 17:25:59,515 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 312
02.12.2021 17:25:59,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1303] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Enabling heartbeat thread
02.12.2021 17:25:59,515 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:596] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully joined group with generation Generation{generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:59,515 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 118405ms for 120000ms of delay, sleeping for 1000ms
02.12.2021 17:25:59,515 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:682] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending follower SyncGroup to coordinator kafka-3.data.sta.redacted:9093 (id: 2147483645 rack: null) at generation Generation{generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}: SyncGroupRequestData(groupId='staging-message-processor-retry2', generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', groupInstanceId=null, protocolType='consumer', protocolName='stream', assignments=[])
02.12.2021 17:25:59,516 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Sending SYNC_GROUP request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=664) and timeout 30000 to node 2147483645: {group_id=staging-message-processor-retry2,generation_id=193,member_id=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd,group_instance_id=null,assignments=[]}
02.12.2021 17:25:59,516 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 340
02.12.2021 17:25:59,520 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,520 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,520 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=646) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer-2191b835-5954-4396-b7a1-da8a33cf97c6,group_instance_id=null}
02.12.2021 17:25:59,520 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 0
02.12.2021 17:25:59,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 44
02.12.2021 17:25:59,521 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@32eb2d83
02.12.2021 17:25:59,521 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 43
02.12.2021 17:25:59,521 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 43
02.12.2021 17:25:59,526 TRACE [org.apache.kafka.clients.consumer.internals.Heartbeat:78] [Heartbeat groupID=staging-message-processor-retry1] Sending heartbeat request with 3000ms remaining on timer
02.12.2021 17:25:59,526 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1075] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending Heartbeat request with generation 43 and member id staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9 to coordinator kafka-4.data.sta.redacted:9093 (id: 2147483644 rack: null)
02.12.2021 17:25:59,526 DEBUG [org.apache.kafka.clients.NetworkClient:522] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Sending HEARTBEAT request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=646) and timeout 30000 to node 2147483644: {group_id=staging-message-processor-retry1,generation_id=43,member_id=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer-5ce21c0f-8033-428d-a1a5-49b4f722f4c9,group_instance_id=null}
02.12.2021 17:25:59,526 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 197
02.12.2021 17:25:59,526 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received HEARTBEAT response from node 2147483644 for request with header RequestHeader(apiKey=HEARTBEAT, apiVersion=3, clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, correlationId=646): org.apache.kafka.common.requests.HeartbeatResponse@21b45cee
02.12.2021 17:25:59,527 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1098] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Received successful Heartbeat response
02.12.2021 17:25:59,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:59,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 195
02.12.2021 17:25:59,527 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 300
02.12.2021 17:25:59,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, correlationId=664): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,546 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,547 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635', protocol='stream'}
02.12.2021 17:25:59,547 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer-19180362-624c-4921-a71f-db9dfe534635
02.12.2021 17:25:59,546 DEBUG [org.apache.kafka.clients.NetworkClient:884] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received SYNC_GROUP response from node 2147483645 for request with header RequestHeader(apiKey=SYNC_GROUP, apiVersion=3, clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, correlationId=664): SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,547 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:740] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Received successful SyncGroup response: SyncGroupResponseData(throttleTimeMs=0, errorCode=0, protocolType=null, protocolName=null, assignment=[0, 1, 0, 0, 0, 0, 0, 0, 0, 40, 0, 0, 0, 8, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, -1, -1, -1, -1, -1, -1, -1])
02.12.2021 17:25:59,547 INFO [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:756] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Successfully synced group in generation Generation{generationId=193, memberId='staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd', protocol='stream'}
02.12.2021 17:25:59,547 DEBUG [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:349] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Executing onJoinComplete with generation 193 and memberId staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer-4c69ca67-635e-42ec-8cca-ed8d0138f4cd
02.12.2021 17:25:59,547 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,547 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,547 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,548 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,548 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,548 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from RUNNING to REBALANCING
02.12.2021 17:25:59,548 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,548 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 309
02.12.2021 17:25:59,547 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:393] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Updating assignment with
02.12.2021 17:25:59,549 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:276] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Notifying assignor about the new Assignment(partitions=[], userDataSize=40)
02.12.2021 17:25:59,549 INFO [org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor:1480] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer] No followup rebalance was requested, resetting the rebalance schedule.
02.12.2021 17:25:59,549 INFO [org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:288] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Adding newly assigned partitions: 
02.12.2021 17:25:59,549 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from RUNNING to PARTITIONS_ASSIGNED
02.12.2021 17:25:59,549 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Pausing partitions []
02.12.2021 17:25:59,549 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 281
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,565 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,565 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,589 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,608 DEBUG [org.apache.kafka.clients.consumer.internals.AbstractCoordinator:1312] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-1-consumer, groupId=staging-message-processor-retry2] Disabling heartbeat thread
02.12.2021 17:25:59,629 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 199
02.12.2021 17:25:59,627 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 95
02.12.2021 17:25:59,648 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 208
02.12.2021 17:25:59,650 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 178
02.12.2021 17:25:59,665 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 400
02.12.2021 17:25:59,689 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 99
02.12.2021 17:25:59,725 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Main Consumer poll completed in 503 ms and fetched 0 records
02.12.2021 17:25:59,727 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,727 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,728 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,728 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 500
02.12.2021 17:25:59,729 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 98
02.12.2021 17:25:59,749 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 107
02.12.2021 17:25:59,751 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 76
02.12.2021 17:25:59,766 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:59,789 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,790 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,790 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,828 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 500
02.12.2021 17:25:59,827 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Main Consumer poll completed in 500 ms and fetched 0 records
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to restore active tasks: {}
02.12.2021 17:25:59,829 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 399
02.12.2021 17:25:59,828 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,829 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Transiting to update standby tasks: {}
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,830 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Initialization call done. State is RUNNING
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Finished restoring all changelogs []
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processing tasks with 1 iterations.
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] 0 punctuators ran.
02.12.2021 17:25:59,830 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2] Invoking poll on main Consumer
02.12.2021 17:25:59,830 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,849 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 7
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:777] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Main Consumer poll completed in 501 ms and fetched 0 records
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:723] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State is PARTITIONS_ASSIGNED; initializing tasks if necessary
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:295] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to restore active tasks: {}
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2017] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Pausing partitions []
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:765] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Paused partitions [] from the restore consumer
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Resuming partitions []
02.12.2021 17:25:59,857 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:321] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Transiting to update standby tasks: {}
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.clients.consumer.KafkaConsumer:2037] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-restore-consumer, groupId=null] Resuming partitions []
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:790] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Resumed partitions [] from the restore consumer
02.12.2021 17:25:59,858 INFO [org.apache.kafka.streams.processor.internals.StreamThread:221] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] State transition from PARTITIONS_ASSIGNED to RUNNING
02.12.2021 17:25:59,858 INFO [org.apache.kafka.streams.KafkaStreams:281] stream-client [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732] State transition from REBALANCING to RUNNING
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:735] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Initialization call done. State is RUNNING
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:740] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotently invoking restoration logic in state RUNNING
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StoreChangelogReader:421] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Finished restoring all changelogs []
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:745] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Idempotent restore call done. Thread state has not changed.
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:646] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processing tasks with 1 iterations.
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:664] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Processed 0 records with 1 iterations; invoking punctuators if necessary
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:675] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] 0 punctuators ran.
02.12.2021 17:25:59,858 DEBUG [org.apache.kafka.streams.processor.internals.StreamThread:750] stream-thread [staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3] Invoking poll on main Consumer
02.12.2021 17:25:59,858 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 500
02.12.2021 17:25:59,860 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 239917ms for 240000ms of delay, sleeping for 93ms
02.12.2021 17:25:59,867 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 198
02.12.2021 17:25:59,891 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 399
02.12.2021 17:25:59,930 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-2-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 400
02.12.2021 17:25:59,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-2-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 299
02.12.2021 17:25:59,929 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-3-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 400
02.12.2021 17:25:59,955 DEBUG [com.sigfox.commons.kafka.DelayedProcessor:39] Current message is at 238903ms for 240000ms of delay, sleeping for 1000ms
02.12.2021 17:25:59,959 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry2-66529824-42fc-40c4-8d79-aa4feea5a732-StreamThread-3-consumer, groupId=staging-message-processor-retry2] Polling for fetches with timeout 399
02.12.2021 17:25:59,975 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry1-4471eaf0-b31d-4236-9d74-11486795c154-StreamThread-3-consumer, groupId=staging-message-processor-retry1] Polling for fetches with timeout 90
02.12.2021 17:25:59,996 TRACE [org.apache.kafka.clients.consumer.KafkaConsumer:1289] [Consumer clientId=staging-message-processor-retry3-cfdd2ebd-a50b-40ed-9076-36cf63fe5b42-StreamThread-2-consumer, groupId=staging-message-processor-retry3] Polling for fetches with timeout 294